-- Logs begin at Sat 2022-10-08 20:01:41 UTC, end at Sat 2022-10-08 20:59:42 UTC. -- Oct 08 20:32:02.412401 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Oct 08 20:32:02.421067 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 08 20:32:02.423142 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 8 20:32:02 2022] *** Oct 08 20:32:02.423142 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 08 20:32:02.423142 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 08 20:32:02.423142 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: nodename: dv-osbrick-master-4-ceph Oct 08 20:32:02.423142 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: machine: x86_64 Oct 08 20:32:02.423142 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: clock source: unix Oct 08 20:32:02.423142 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: pcre jit disabled Oct 08 20:32:02.423142 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: detected number of CPU cores: 4 Oct 08 20:32:02.423142 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: current working directory: / Oct 08 20:32:02.423142 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: detected binary path: /usr/bin/uwsgi-core Oct 08 20:32:02.423693 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: your processes number limit is 47680 Oct 08 20:32:02.423693 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: your memory page size is 4096 bytes Oct 08 20:32:02.423693 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: detected max file descriptor number: 2048 Oct 08 20:32:02.423693 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: lock engine: pthread robust mutexes Oct 08 20:32:02.423693 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: thunder lock: enabled Oct 08 20:32:02.423693 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 08 20:32:02.423693 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 08 20:32:02.467492 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: Python main interpreter initialized at 0x55a92bc6b9c0 Oct 08 20:32:02.467492 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: python threads support enabled Oct 08 20:32:02.467492 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: your server socket listen backlog is limited to 100 connections Oct 08 20:32:02.467492 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: your mercy for graceful operations on workers is 90 seconds Oct 08 20:32:02.467850 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: mapped 403077 bytes (393 KB) for 2 cores Oct 08 20:32:02.467927 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: *** Operational MODE: preforking *** Oct 08 20:32:02.468138 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: *** uWSGI is running in multiple interpreter mode *** Oct 08 20:32:02.468138 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: spawned uWSGI master process (pid: 94730) Oct 08 20:32:02.468332 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Oct 08 20:32:02.469960 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: spawned uWSGI worker 1 (pid: 94741, cores: 1) Oct 08 20:32:02.469960 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: spawned uWSGI worker 2 (pid: 94742, cores: 1) Oct 08 20:32:02.469960 dv-osbrick-master-4-ceph devstack@keystone.service[94730]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 08 20:32:07.075731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:32:07.075731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: from cryptography.utils import int_from_bytes Oct 08 20:32:07.076437 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:32:07.076437 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: from cryptography.utils import int_from_bytes Oct 08 20:32:07.076575 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:32:07.076575 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: from cryptography.utils import int_from_bytes Oct 08 20:32:07.076575 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 08 20:32:07.076575 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: from cryptography.utils import int_from_bytes Oct 08 20:32:07.126005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 08 20:32:07.126173 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 08 20:32:07.126259 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 08 20:32:07.126353 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 08 20:32:07.126429 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] command line args: [] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 08 20:32:07.126506 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] command line args: [] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 08 20:32:07.126627 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 08 20:32:07.126748 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 08 20:32:07.126821 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ================================================================================ {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 08 20:32:07.126894 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ================================================================================ {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 08 20:32:07.127032 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] admin_token = **** {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.127124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] admin_token = **** {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.127269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] config_dir = [] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.127360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] config_dir = [] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.127438 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.127520 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.127598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] config_source = [] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.127673 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] config_source = [] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.127779 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] debug = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.127862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] debug = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.127977 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.128234 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.128321 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.128380 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.128512 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.128595 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.128743 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.128821 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.128986 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.129061 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.129210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] list_limit = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.129293 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] list_limit = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.129395 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] log_config_append = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.129475 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] log_config_append = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.129570 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.129647 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.129718 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] log_dir = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.129782 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] log_dir = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.129925 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] log_file = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.130017 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] log_file = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.130126 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.130200 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.130363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.130473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.130603 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.130696 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.130836 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.130921 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.131002 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.131074 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.131183 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.131301 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.131418 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.131518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.131660 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.131777 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.132406 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.132496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.132642 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.132746 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.132872 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.132954 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.133100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.133180 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.133344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.133433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.133587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.133673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.133858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.133990 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.134357 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.134451 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.134519 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] publish_errors = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.134586 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] publish_errors = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.134751 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.134854 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.135012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.135087 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.135153 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.135223 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.135351 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.135448 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.135579 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.135670 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.135810 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] standard_threads = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.135897 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] standard_threads = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.136038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.136158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.136278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.136441 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.136566 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.136690 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.136841 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] use_journal = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.136968 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] use_journal = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.137075 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] use_json = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.137197 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] use_json = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.137345 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] use_stderr = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.137463 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] use_stderr = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.137577 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] use_syslog = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.137691 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] use_syslog = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.137805 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.137954 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 08 20:32:07.138074 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.138196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.138319 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.138441 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.138557 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.138668 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.138767 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.138877 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.138976 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.139089 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.139188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.139292 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.139391 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.139489 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.139592 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.139708 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.139822 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.139945 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.140069 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.140191 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.140307 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.140428 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.140543 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.140666 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.140781 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.140896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.141016 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.141133 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.141248 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.141370 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.141486 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.141606 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.141721 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.141835 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.141964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.142160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.142281 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.142396 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.142516 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.142632 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.142747 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.142873 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.142989 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.143103 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.143219 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.143340 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.143455 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.143578 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.143693 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.143815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.143931 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.144046 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.144169 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.144291 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.144406 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.144520 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.144634 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.144748 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.144870 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.144991 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.145112 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.145228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.145349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.145465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.145591 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.145707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.145820 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.145987 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.146107 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.146221 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.146344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.146462 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.146577 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.146691 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.146812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.146928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.147050 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.147173 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.147295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.147421 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.148104 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.148227 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.148418 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.148538 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.148653 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.148767 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.148881 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.148995 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.149118 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.149234 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.149349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.149463 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.149579 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.149693 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.149815 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.149944 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.150061 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.150187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.150295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.150408 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.150534 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.150657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.150774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.150889 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.151002 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.151116 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.151241 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.151363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.151479 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.151600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.151716 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.151863 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.152107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.152228 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.152349 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.152465 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.152591 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.152709 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.152830 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.152946 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.153067 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.153184 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.153307 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.153424 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.153551 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.153676 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.153802 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.153965 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.154084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.154254 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.154386 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.154511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.154628 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.154744 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.154860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.154982 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.155110 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.155227 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.155342 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.155552 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.155674 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.155790 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.155920 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.156038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.156161 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.156283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.156400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.156515 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.156639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.156756 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.156872 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.156987 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.157102 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.157217 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.157340 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.157457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.157572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.157687 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.157826 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.157966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.158096 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.158220 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.158337 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.158453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.158600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.158717 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.158842 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.158961 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.159077 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.159192 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.159313 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.159456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.159583 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.159700 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.159815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.159930 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.160046 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.160167 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.160357 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.160476 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.160603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.160720 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.160843 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.160959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.161084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.161209 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.161337 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.161461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.161578 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.161693 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.161693 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.161939 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.162071 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.162194 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.162309 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.162425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.162541 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.162668 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.162786 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.162902 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.163017 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.163133 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.163241 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.163366 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.163490 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.163607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.163723 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.163847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.163964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.164088 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.164206 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.164322 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.164463 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] auth.external = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.164589 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.164707 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.164824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] auth.external = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.164824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.165050 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.165050 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.165279 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.165279 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.165499 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] auth.password = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.165616 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] auth.password = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.165741 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] auth.token = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.165860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] auth.token = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.166006 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.166126 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.166242 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.166360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.166484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.166601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.166718 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.166834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.166950 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.167066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.167190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.167308 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.167426 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.167543 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.167659 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] credential.caching = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.167782 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] credential.caching = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.167908 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.168026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.168143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.168266 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.168384 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.168501 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.168629 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.168748 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.168865 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.168981 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.169098 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.169214 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.169339 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.169465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.169582 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.169707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.169825 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.169987 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.170121 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.170240 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.170357 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.170475 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.170592 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.170709 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.170834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.170952 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.171068 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.171185 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.171301 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.171418 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.171543 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] federation.caching = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.171661 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] federation.caching = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.171778 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.171894 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.172011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.172131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.172257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.172375 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.172492 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.172609 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.172726 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.172843 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.172968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.173086 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.173203 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.173319 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.173436 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.173565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.173685 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.173802 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.173935 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.174054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.174171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.174171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity.caching = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.174472 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.174472 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity.caching = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.174693 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.174693 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.174918 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.175044 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.175162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.175278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.175395 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.175511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.175627 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.175753 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.175870 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.175987 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.176103 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.176220 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.176336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.176460 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.176578 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.176695 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.176812 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.176928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.177051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.177180 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.177303 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.177421 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.177537 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.177654 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.177770 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.177951 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.178071 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.178188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.178304 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.178420 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.178537 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.178666 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.178785 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.178886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.179001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.179118 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.179234 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.179359 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.179477 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.179593 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.179718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.179836 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.179953 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.180081 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.180199 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.180314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.180431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.180547 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.180662 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.180786 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.180904 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.181021 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.181138 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.181253 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.181369 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.181493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.181610 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.181610 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.181827 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.181958 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.182076 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.182209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.182329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.182329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.182545 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.182661 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.182777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.182901 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.183010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.183108 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.183207 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.183321 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.183438 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.183564 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.183682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.183798 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.183914 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.184029 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.184147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.184271 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.184389 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.184505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.184621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.184737 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.184853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.184977 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.185103 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.185222 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.185338 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.185454 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.185582 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.185700 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.185815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.185944 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.186062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.186178 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.186307 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.186426 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.186542 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.186658 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.186774 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.186889 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.187014 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.187132 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.187249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.187365 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.187482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.187598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.187723 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.187840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.187840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.188057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.188173 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.188289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.188414 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.188532 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.188649 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.188765 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.188881 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.188881 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.189106 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.189223 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.189340 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.189457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.189572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.189688 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.189812 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.189963 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.190083 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.190200 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.190316 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.190434 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.190559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.190676 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.190793 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.190909 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.191026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.191142 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.191266 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.191384 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.191501 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.191617 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.191734 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.191850 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.191975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.192092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.192214 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.192330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.192447 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.192564 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.192688 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.192806 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.192922 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.193038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.193154 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.193270 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.193395 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.193512 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.193630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.193746 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.193862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.193994 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.194123 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.194241 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.194913 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.195038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.195155 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.195271 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.195521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.195643 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] resource.caching = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.195760 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.195884 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.196008 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.196126 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.196251 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.196368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.196484 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] resource.caching = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.196600 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.196718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.196834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.196958 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.197076 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.197192 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.197192 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.197539 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.197659 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.197849 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.198016 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.198134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.198250 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.198250 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.198468 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] role.caching = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.198601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.198720 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] role.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.198838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] role.caching = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.198954 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.199077 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] role.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.199194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.199319 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.199436 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.199553 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.199669 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.199786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.199911 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.200029 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.200146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.200263 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.200380 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.200497 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.200626 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.200745 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.200862 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.200980 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.201097 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.201214 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.201338 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.201456 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.201572 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.201689 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.201805 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.201936 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.202069 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.202188 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.202188 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.202531 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.202531 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.202753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.202879 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.202999 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.203115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.203232 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.203349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.203465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.203590 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.203708 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.203825 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.203941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.204058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.204175 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.204300 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.204418 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.204535 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.204658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.204776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.204901 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.205020 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.205137 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.205254 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.205370 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.205486 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.205611 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.205729 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.205846 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.206029 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.206148 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.206264 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.206393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.206512 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.206628 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.206744 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.206860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.206976 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] token.caching = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.207101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.207220 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.207337 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] token.caching = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.207454 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.207570 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.207686 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.207810 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.207928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.208045 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.208161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.208278 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.208394 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.208519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.208636 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.208753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.208869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.208985 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.209101 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.209226 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.209345 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.209462 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.209578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.209694 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.209809 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.209983 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.210765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.210924 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.211133 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.211251 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.211368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.211499 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.211631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.211751 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.211876 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.212003 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.212122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.connection = **** {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.212239 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.212355 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.212476 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.connection = **** {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.212603 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.212722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.212838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.212955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.213071 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.213188 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.213313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.213431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.213549 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.213666 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.213783 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.213929 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.214063 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.214182 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.214298 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.214415 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.214532 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.214532 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.214760 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.214760 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.214981 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.215097 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.215213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.215330 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.215455 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.215574 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.215691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.215807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.215923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.216039 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.216163 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.216281 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.216397 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.216397 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 08 20:32:07.216616 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.216616 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 08 20:32:07.216616 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 08 20:32:07.241343 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.241687 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.241774 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.241936 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.242144 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.242233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.250374 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.250753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.280384 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.280607 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.280740 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.280970 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.333037 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.333437 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.382926 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.383150 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.383661 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.383896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.450136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.450359 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.450576 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.450774 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.450861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.450984 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.451066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.451195 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.451279 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.451416 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.451629 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.451839 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.474302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.474412 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.474555 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.474737 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.474833 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.474930 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.475011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.475089 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.475165 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.475241 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.475348 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.475443 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.475584 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.475671 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.486975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.487248 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.500004 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.500270 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.500363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.500440 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.500581 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.500681 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.500807 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.500892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.501029 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.501114 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.501245 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.501338 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.501458 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.501669 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 08 20:32:07.518082 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.518255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.518356 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 08 20:32:07.518462 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 08 20:32:07.518619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.518798 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.518884 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 08 20:32:07.518995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 08 20:32:07.519088 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.519265 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.519347 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.519522 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.519604 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.519776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.519860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.520027 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.529732 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.529995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.530089 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.530274 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.530360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.530542 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.530625 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.530830 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.537414 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.537685 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.540361 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.540645 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.540809 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.540930 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.541090 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.541213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.541372 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.541493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.541652 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.541743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.541955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.542040 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.542215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.542295 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.542480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.542562 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.542762 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.542843 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.543046 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.543139 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.543316 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.543585 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.567477 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.568267 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.568923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.569204 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.569876 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.570175 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.573754 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.574065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.574462 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.574676 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.574959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.575351 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.580857 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.581138 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.581622 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.581919 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.585779 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.586048 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.586312 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.586408 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.586660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.586742 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.586938 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.587065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.587214 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.587324 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.587484 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.587599 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.587750 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.587872 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.588139 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.588402 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.603324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.603607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.603806 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.604080 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.607433 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.607934 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.610813 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.611217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.611311 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.611691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.615418 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.615863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.619074 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.619624 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.622145 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.622446 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.622709 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.622792 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.623005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.623129 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.623284 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.623409 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.623686 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.623778 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.623963 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.624255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.639429 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.639726 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.639992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.640137 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.640252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.640423 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.640688 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.640947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.646978 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.648421 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.649139 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.650085 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.650693 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.650977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.651617 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.651892 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.653566 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.653856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.654170 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.654466 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.654552 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.654739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.654821 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.655073 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.655366 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.655639 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.666539 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.666820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.667098 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.667385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.667467 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.667667 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.667748 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.667941 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.668023 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.668213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.668301 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.668503 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.668776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.669043 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.683642 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.684420 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.686680 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.687428 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.689550 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.690324 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.690994 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.691729 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.692464 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.692755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.693034 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.693195 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.693483 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.693761 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.700165 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.700727 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.701619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.702183 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.704501 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.704789 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.705013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.705096 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.705301 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.705381 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.705579 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.705851 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.714931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.715215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.715299 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.715495 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.715576 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.715774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.722346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.722621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 08 20:32:07.722704 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.722899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.722991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.723172 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.723252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.723439 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.723520 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.723704 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.723798 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.723969 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.724060 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.724237 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.724361 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.724524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.724605 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.724786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.724866 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.725052 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.725141 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.725310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.725391 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.726199 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.726303 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.726471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.726583 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.726741 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 08 20:32:07.760168 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a92bc6b9c0 pid: 94742 (default app) Oct 08 20:32:07.760286 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a92bc6b9c0 pid: 94741 (default app) Oct 08 20:32:07.763564 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3582b-afa8-42e8-a797-a2681b8ccf25 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:07.763856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3582b-afa8-42e8-a797-a2681b8ccf25 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:07.764131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3582b-afa8-42e8-a797-a2681b8ccf25 None None] PATH_INFO: `/v3` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:07.768277 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Sat Oct 8 20:32:07 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:15.180442 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e5259-b875-4b7f-a807-b9658c89a362 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:15.180976 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e5259-b875-4b7f-a807-b9658c89a362 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:15.180976 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e5259-b875-4b7f-a807-b9658c89a362 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:15.185207 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:15.190520 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04973f-2965-4262-a6a6-4d94728b1a53 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:15.191067 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04973f-2965-4262-a6a6-4d94728b1a53 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:15.191067 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04973f-2965-4262-a6a6-4d94728b1a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:15.268149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: INFO dbcounter [None req-cb04973f-2965-4262-a6a6-4d94728b1a53 None None] Registered counter for database keystone Oct 08 20:32:15.287468 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG oslo_db.sqlalchemy.engines [None req-cb04973f-2965-4262-a6a6-4d94728b1a53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:32:15.294521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writer thread running {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:32:15.475196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG passlib.handlers.bcrypt [None req-cb04973f-2965-4262-a6a6-4d94728b1a53 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=94742) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 08 20:32:15.476326 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG passlib.handlers.bcrypt [None req-cb04973f-2965-4262-a6a6-4d94728b1a53 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94742) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 08 20:32:15.535591 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-cb04973f-2965-4262-a6a6-4d94728b1a53 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:15.537189 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-cb04973f-2965-4262-a6a6-4d94728b1a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:15.671242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 08 20:32:16.175986 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e5259-b875-4b7f-a807-b9658c89a362 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:16.251487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: INFO dbcounter [None req-fd2e5259-b875-4b7f-a807-b9658c89a362 None None] Registered counter for database keystone Oct 08 20:32:16.272962 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG oslo_db.sqlalchemy.engines [None req-fd2e5259-b875-4b7f-a807-b9658c89a362 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 08 20:32:16.279305 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writer thread running {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 08 20:32:16.397561 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e5259-b875-4b7f-a807-b9658c89a362 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:16.402046 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a497d30-fdf0-4af1-99a2-e255e3403b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:16.402670 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a497d30-fdf0-4af1-99a2-e255e3403b4c admin admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:16.402948 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a497d30-fdf0-4af1-99a2-e255e3403b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:16.403218 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a497d30-fdf0-4af1-99a2-e255e3403b4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:16.412072 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a497d30-fdf0-4af1-99a2-e255e3403b4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:16.464363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7a497d30-fdf0-4af1-99a2-e255e3403b4c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 08 20:32:16.464699 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a497d30-fdf0-4af1-99a2-e255e3403b4c admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:16.474797 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Sat Oct 8 20:32:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 08 20:32:16.481582 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04973f-2965-4262-a6a6-4d94728b1a53 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:16.501253 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04973f-2965-4262-a6a6-4d94728b1a53 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:16.505691 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5bddc-58c1-4cbf-8d35-defc0bc0a787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:16.506925 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5bddc-58c1-4cbf-8d35-defc0bc0a787 admin admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:16.507208 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5bddc-58c1-4cbf-8d35-defc0bc0a787 admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:16.507492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5bddc-58c1-4cbf-8d35-defc0bc0a787 admin admin] PATH_INFO: `/v3/projects/552b2e45ebde4268bba84c6dbc8036cb` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:16.508926 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5bddc-58c1-4cbf-8d35-defc0bc0a787 admin admin] RBAC: Authorizing `identity:get_project(project_id=552b2e45ebde4268bba84c6dbc8036cb)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:16.561345 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: WARNING keystone.common.rbac_enforcer.enforcer [None req-60d5bddc-58c1-4cbf-8d35-defc0bc0a787 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 08 20:32:16.561692 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5bddc-58c1-4cbf-8d35-defc0bc0a787 admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:16.566417 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Sat Oct 8 20:32:16 2022] GET /identity/v3/projects/552b2e45ebde4268bba84c6dbc8036cb => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:32:18.946072 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec25fc-1e11-4974-88e9-73353f42f915 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:18.946621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec25fc-1e11-4974-88e9-73353f42f915 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:18.946621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec25fc-1e11-4974-88e9-73353f42f915 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:18.950686 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:32:18.956126 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ab52c-e0f4-4997-97ae-758756090a84 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:18.956511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ab52c-e0f4-4997-97ae-758756090a84 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:18.956685 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ab52c-e0f4-4997-97ae-758756090a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:18.977548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-162ab52c-e0f4-4997-97ae-758756090a84 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:18.979113 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-162ab52c-e0f4-4997-97ae-758756090a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:18.987187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 08 20:32:19.304858 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec25fc-1e11-4974-88e9-73353f42f915 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:19.317118 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec25fc-1e11-4974-88e9-73353f42f915 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:19.321998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec430c-c10a-4679-a09e-37acf3918669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:19.322603 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec430c-c10a-4679-a09e-37acf3918669 admin admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:19.322883 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec430c-c10a-4679-a09e-37acf3918669 admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:19.323153 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec430c-c10a-4679-a09e-37acf3918669 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:19.331021 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec430c-c10a-4679-a09e-37acf3918669 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:19.332765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec430c-c10a-4679-a09e-37acf3918669 admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:19.341901 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Sat Oct 8 20:32:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 08 20:32:19.347475 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ab52c-e0f4-4997-97ae-758756090a84 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:19.356561 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ab52c-e0f4-4997-97ae-758756090a84 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:19.361063 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a1f26-d079-47c8-a2b6-3c5e8cf026aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:19.361670 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a1f26-d079-47c8-a2b6-3c5e8cf026aa admin admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:19.361978 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a1f26-d079-47c8-a2b6-3c5e8cf026aa admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:19.362255 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a1f26-d079-47c8-a2b6-3c5e8cf026aa admin admin] PATH_INFO: `/v3/users/38722554f5ac49c2a9cfb6efcc8e8b54` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:19.363556 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a1f26-d079-47c8-a2b6-3c5e8cf026aa admin admin] RBAC: Authorizing `identity:get_user(user_id=38722554f5ac49c2a9cfb6efcc8e8b54)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:19.365329 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a1f26-d079-47c8-a2b6-3c5e8cf026aa admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:19.367410 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Sat Oct 8 20:32:19 2022] GET /identity/v3/users/38722554f5ac49c2a9cfb6efcc8e8b54 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:21.814540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca50bc0-6b47-46ef-a9c9-4e42fecaa2fe None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:21.815079 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca50bc0-6b47-46ef-a9c9-4e42fecaa2fe None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:21.815079 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca50bc0-6b47-46ef-a9c9-4e42fecaa2fe None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:21.816556 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:21.822390 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715d12-c7aa-4f36-bb16-a0aa6561107b None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:21.822820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715d12-c7aa-4f36-bb16-a0aa6561107b None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:21.822927 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715d12-c7aa-4f36-bb16-a0aa6561107b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:21.841044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-b5715d12-c7aa-4f36-bb16-a0aa6561107b None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:21.842236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-b5715d12-c7aa-4f36-bb16-a0aa6561107b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:21.853386 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b18eb-a436-44ee-a694-86e15ec7951b None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:21.853731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b18eb-a436-44ee-a694-86e15ec7951b None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:21.854046 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b18eb-a436-44ee-a694-86e15ec7951b None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:21.855371 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:32:21.860706 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43cef1-96ad-42ff-a429-562a72e33e56 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:21.860984 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43cef1-96ad-42ff-a429-562a72e33e56 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:21.861253 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43cef1-96ad-42ff-a429-562a72e33e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:21.907279 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG passlib.handlers.bcrypt [None req-aa43cef1-96ad-42ff-a429-562a72e33e56 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=94741) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 08 20:32:21.907694 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG passlib.handlers.bcrypt [None req-aa43cef1-96ad-42ff-a429-562a72e33e56 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94741) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 08 20:32:21.958673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-aa43cef1-96ad-42ff-a429-562a72e33e56 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:21.961696 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-aa43cef1-96ad-42ff-a429-562a72e33e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:22.038646 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:22.065990 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:32:22.359305 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5715d12-c7aa-4f36-bb16-a0aa6561107b None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:22.381625 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43cef1-96ad-42ff-a429-562a72e33e56 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:22.384031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:22.466362 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5715d12-c7aa-4f36-bb16-a0aa6561107b None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:22.483081 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43cef1-96ad-42ff-a429-562a72e33e56 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:22.485600 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:22.501242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4e989-bd7b-4708-a161-236077fb8626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:22.501870 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4e989-bd7b-4708-a161-236077fb8626 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:22.502169 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4e989-bd7b-4708-a161-236077fb8626 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:22.502441 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4e989-bd7b-4708-a161-236077fb8626 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:22.514058 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4e989-bd7b-4708-a161-236077fb8626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:22.521554 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c24fb-3752-4954-a0d9-0b84c53d1294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:22.522539 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c24fb-3752-4954-a0d9-0b84c53d1294 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:22.522825 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c24fb-3752-4954-a0d9-0b84c53d1294 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-39c4e989-bd7b-4708-a161-236077fb8626 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:22.522923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:22.523928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:22.524755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:22.524755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:22.524755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:22.524755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:22.524755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:22.524755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:22.524755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:22.524755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:22.524755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:22.524755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:22.524755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:32:22.524755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:32:22.525378 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c24fb-3752-4954-a0d9-0b84c53d1294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:22.525444 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:32:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:22.529807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4e989-bd7b-4708-a161-236077fb8626 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:22.590370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c24fb-3752-4954-a0d9-0b84c53d1294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:22.591801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c24fb-3752-4954-a0d9-0b84c53d1294 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:22.609448 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:22.627789 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4e989-bd7b-4708-a161-236077fb8626 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:22.662584 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86834f-4a81-4a7f-b8b2-9b53cc384a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:22.663191 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86834f-4a81-4a7f-b8b2-9b53cc384a52 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:22.663471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86834f-4a81-4a7f-b8b2-9b53cc384a52 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:22.663739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86834f-4a81-4a7f-b8b2-9b53cc384a52 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:22.664424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86834f-4a81-4a7f-b8b2-9b53cc384a52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:22.664725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86834f-4a81-4a7f-b8b2-9b53cc384a52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:22.666108 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86834f-4a81-4a7f-b8b2-9b53cc384a52 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:22.677814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:32:22.684060 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86834f-4a81-4a7f-b8b2-9b53cc384a52 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:22.689519 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:32:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:32:22.695677 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c24fb-3752-4954-a0d9-0b84c53d1294 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:22.698374 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:22.781861 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86834f-4a81-4a7f-b8b2-9b53cc384a52 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:22.791172 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c24fb-3752-4954-a0d9-0b84c53d1294 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:22.816500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb654a5b-984b-4aeb-9986-aac2372c1de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:22.817115 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb654a5b-984b-4aeb-9986-aac2372c1de0 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:22.817393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb654a5b-984b-4aeb-9986-aac2372c1de0 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:22.817662 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb654a5b-984b-4aeb-9986-aac2372c1de0 None admin] PATH_INFO: `/v3/users/38722554f5ac49c2a9cfb6efcc8e8b54` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:22.818833 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb654a5b-984b-4aeb-9986-aac2372c1de0 None admin] RBAC: Authorizing `identity:get_user(user_id=38722554f5ac49c2a9cfb6efcc8e8b54)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:22.820284 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb654a5b-984b-4aeb-9986-aac2372c1de0 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:22.821805 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:22 2022] GET /identity/v3/users/38722554f5ac49c2a9cfb6efcc8e8b54 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:32:22.826764 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f3b7d-bae4-4e29-b63c-dc7585de242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:22.827245 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb654a5b-984b-4aeb-9986-aac2372c1de0 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:22.827658 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f3b7d-bae4-4e29-b63c-dc7585de242b None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:22.827942 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f3b7d-bae4-4e29-b63c-dc7585de242b None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:22.828217 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f3b7d-bae4-4e29-b63c-dc7585de242b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:22.841230 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:22.933145 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb654a5b-984b-4aeb-9986-aac2372c1de0 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:22.954611 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f3b7d-bae4-4e29-b63c-dc7585de242b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:22.956079 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f3b7d-bae4-4e29-b63c-dc7585de242b None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:22.968695 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0df83-57e3-47a8-a1bc-38cc82a8d3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:22.969327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0df83-57e3-47a8-a1bc-38cc82a8d3d8 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:22.969611 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0df83-57e3-47a8-a1bc-38cc82a8d3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:22.969900 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0df83-57e3-47a8-a1bc-38cc82a8d3d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:22.971032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0df83-57e3-47a8-a1bc-38cc82a8d3d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:22.972454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0df83-57e3-47a8-a1bc-38cc82a8d3d8 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-616f3b7d-bae4-4e29-b63c-dc7585de242b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:32:22.973832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:22.974885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:32:22.976598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:32:22.976598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:32:22.976598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:32:22.976796 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 10/18] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:32:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:32:22.976873 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 9/19] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:22.980251 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0df83-57e3-47a8-a1bc-38cc82a8d3d8 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:22.980817 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f3b7d-bae4-4e29-b63c-dc7585de242b None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:23.039815 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:23.066717 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:23.084267 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f3b7d-bae4-4e29-b63c-dc7585de242b None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:23.086288 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0df83-57e3-47a8-a1bc-38cc82a8d3d8 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:23.120205 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a71dc-bb34-403f-b164-aeecca528d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:23.120639 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87cdc6-0c8b-4775-bec4-e8c49936ee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:23.120808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a71dc-bb34-403f-b164-aeecca528d92 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:23.121090 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a71dc-bb34-403f-b164-aeecca528d92 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:23.121236 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87cdc6-0c8b-4775-bec4-e8c49936ee51 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:23.121363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a71dc-bb34-403f-b164-aeecca528d92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:23.121514 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87cdc6-0c8b-4775-bec4-e8c49936ee51 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:23.121784 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87cdc6-0c8b-4775-bec4-e8c49936ee51 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:23.122116 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a71dc-bb34-403f-b164-aeecca528d92 None admin] RBAC: Adding query filter params (role.id=323ca657fe7b4b878fd8328ef78f29f4, scope.domain.id=default, user.id=38722554f5ac49c2a9cfb6efcc8e8b54) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:23.122424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a71dc-bb34-403f-b164-aeecca528d92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:23.122522 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87cdc6-0c8b-4775-bec4-e8c49936ee51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:23.122734 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87cdc6-0c8b-4775-bec4-e8c49936ee51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:23.123849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a71dc-bb34-403f-b164-aeecca528d92 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:23.124068 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87cdc6-0c8b-4775-bec4-e8c49936ee51 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:23.130533 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 11/20] 10.222.0.36 () {56 vars in 1322 bytes} [Sat Oct 8 20:32:22 2022] GET /identity/v3/role_assignments?user.id=38722554f5ac49c2a9cfb6efcc8e8b54&scope.domain.id=default&role.id=323ca657fe7b4b878fd8328ef78f29f4 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:23.142260 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 10/21] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:32:25.805061 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c739dc-8613-4452-b0e3-24f4dad85563 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:25.806183 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c739dc-8613-4452-b0e3-24f4dad85563 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:25.806687 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c739dc-8613-4452-b0e3-24f4dad85563 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:25.808704 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 12/22] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:25.814129 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9da9ba-0226-4a0a-9129-b3d856af467d None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:25.815001 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9da9ba-0226-4a0a-9129-b3d856af467d None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:25.815503 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9da9ba-0226-4a0a-9129-b3d856af467d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:25.839519 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-8c9da9ba-0226-4a0a-9129-b3d856af467d None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:25.841041 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-8c9da9ba-0226-4a0a-9129-b3d856af467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:25.947417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 11/23] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:26.062790 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a62e3-ac05-4ab1-b84c-90318d7a5fc2 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:26.063319 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a62e3-ac05-4ab1-b84c-90318d7a5fc2 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:26.063826 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a62e3-ac05-4ab1-b84c-90318d7a5fc2 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:26.065353 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:26.071947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5434d-4857-4ffb-ac45-6c6c186bcc9d None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:26.072512 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5434d-4857-4ffb-ac45-6c6c186bcc9d None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:26.073043 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5434d-4857-4ffb-ac45-6c6c186bcc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:26.099091 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-b7c5434d-4857-4ffb-ac45-6c6c186bcc9d None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:26.100967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-b7c5434d-4857-4ffb-ac45-6c6c186bcc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:26.161189 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:26.200200 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 12/25] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:26.437618 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b12263-817f-4257-9fae-2d0d83e11568 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:26.438287 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b12263-817f-4257-9fae-2d0d83e11568 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:26.438797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b12263-817f-4257-9fae-2d0d83e11568 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:26.440335 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 14/26] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:26.446105 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d7b17-c3e1-46cf-9ab3-8619f4fcca2e None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:26.446395 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d7b17-c3e1-46cf-9ab3-8619f4fcca2e None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:26.446676 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d7b17-c3e1-46cf-9ab3-8619f4fcca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:26.468556 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b12263-817f-4257-9fae-2d0d83e11568 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:26.479065 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-dd2d7b17-c3e1-46cf-9ab3-8619f4fcca2e None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:26.480291 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-dd2d7b17-c3e1-46cf-9ab3-8619f4fcca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:26.580221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 13/27] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:26.671718 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d7b17-c3e1-46cf-9ab3-8619f4fcca2e None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:26.693281 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b12263-817f-4257-9fae-2d0d83e11568 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:26.774923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f42b3d-0d5a-41b6-a996-0f9acbbaba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:26.775614 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f42b3d-0d5a-41b6-a996-0f9acbbaba69 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:26.775901 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f42b3d-0d5a-41b6-a996-0f9acbbaba69 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:26.776179 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f42b3d-0d5a-41b6-a996-0f9acbbaba69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:26.810236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f42b3d-0d5a-41b6-a996-0f9acbbaba69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-d6f42b3d-0d5a-41b6-a996-0f9acbbaba69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:26.823975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:26.825066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:26.826044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:26.826044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:26.826044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:26.826044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:26.826044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:26.826044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:26.826044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:26.826044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:26.826044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:26.826044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:26.826044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:32:26.826044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:32:26.828712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 15/28] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:32:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:32:26.837685 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f42b3d-0d5a-41b6-a996-0f9acbbaba69 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:26.850232 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:26.889230 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d7b17-c3e1-46cf-9ab3-8619f4fcca2e None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:26.904261 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:26.991210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5748c-413d-4f6e-afb9-7a456953383d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:26.991873 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5748c-413d-4f6e-afb9-7a456953383d None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:26.992150 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5748c-413d-4f6e-afb9-7a456953383d None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:26.992420 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5748c-413d-4f6e-afb9-7a456953383d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:27.018936 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5748c-413d-4f6e-afb9-7a456953383d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:27.020426 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5748c-413d-4f6e-afb9-7a456953383d None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:27.023280 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f42b3d-0d5a-41b6-a996-0f9acbbaba69 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-8df5748c-413d-4f6e-afb9-7a456953383d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:32:27.048146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:27.049078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:32:27.050016 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:32:27.050016 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:32:27.050016 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:32:27.050016 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 14/29] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:32:27.065234 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5748c-413d-4f6e-afb9-7a456953383d None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:27.092925 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33e1bd-7d0b-4d64-b49d-659e926f0238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:27.093541 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33e1bd-7d0b-4d64-b49d-659e926f0238 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:27.093819 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33e1bd-7d0b-4d64-b49d-659e926f0238 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:27.094119 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33e1bd-7d0b-4d64-b49d-659e926f0238 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:27.094789 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33e1bd-7d0b-4d64-b49d-659e926f0238 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:27.095091 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33e1bd-7d0b-4d64-b49d-659e926f0238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:27.096466 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33e1bd-7d0b-4d64-b49d-659e926f0238 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:27.111003 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 16/30] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:32:27.126330 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33e1bd-7d0b-4d64-b49d-659e926f0238 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:27.208935 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:27.216322 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5748c-413d-4f6e-afb9-7a456953383d None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:27.250178 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33e1bd-7d0b-4d64-b49d-659e926f0238 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:27.255951 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74296ccf-1ce7-4111-9621-3ae11763ff12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:27.257404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74296ccf-1ce7-4111-9621-3ae11763ff12 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:27.257861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74296ccf-1ce7-4111-9621-3ae11763ff12 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:27.258328 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74296ccf-1ce7-4111-9621-3ae11763ff12 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:27.259127 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74296ccf-1ce7-4111-9621-3ae11763ff12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:27.259589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74296ccf-1ce7-4111-9621-3ae11763ff12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:27.261227 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74296ccf-1ce7-4111-9621-3ae11763ff12 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:27.274367 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 15/31] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:27.279117 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74296ccf-1ce7-4111-9621-3ae11763ff12 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:27.296025 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35141f9-ae74-432e-bc05-c313ad26d8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:27.297125 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35141f9-ae74-432e-bc05-c313ad26d8ab None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:27.297607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35141f9-ae74-432e-bc05-c313ad26d8ab None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:27.298205 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35141f9-ae74-432e-bc05-c313ad26d8ab None admin] PATH_INFO: `/v3/users/38722554f5ac49c2a9cfb6efcc8e8b54` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:27.299664 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35141f9-ae74-432e-bc05-c313ad26d8ab None admin] RBAC: Authorizing `identity:get_user(user_id=38722554f5ac49c2a9cfb6efcc8e8b54)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:27.301489 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35141f9-ae74-432e-bc05-c313ad26d8ab None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:27.308145 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 17/32] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:27 2022] GET /identity/v3/users/38722554f5ac49c2a9cfb6efcc8e8b54 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:32:27.308700 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:27.311134 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a728b0-114f-40a8-8472-c78322bfe810 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:27.311889 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a728b0-114f-40a8-8472-c78322bfe810 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:27.312303 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a728b0-114f-40a8-8472-c78322bfe810 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:27.313788 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 18/33] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:27.314840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a728b0-114f-40a8-8472-c78322bfe810 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:27.405193 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74296ccf-1ce7-4111-9621-3ae11763ff12 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:27.447860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4a01e-94fe-4bec-83df-3ac409302104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:27.448780 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4a01e-94fe-4bec-83df-3ac409302104 None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:27.449069 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4a01e-94fe-4bec-83df-3ac409302104 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:27.449395 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4a01e-94fe-4bec-83df-3ac409302104 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:27.450449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4a01e-94fe-4bec-83df-3ac409302104 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:27.452161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4a01e-94fe-4bec-83df-3ac409302104 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:27.457456 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a728b0-114f-40a8-8472-c78322bfe810 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:27.500685 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15057985-04d6-4e64-869e-7f4bae8cb659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:27.501697 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15057985-04d6-4e64-869e-7f4bae8cb659 None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:27.502344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15057985-04d6-4e64-869e-7f4bae8cb659 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:27.502814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15057985-04d6-4e64-869e-7f4bae8cb659 None admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:27.503711 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15057985-04d6-4e64-869e-7f4bae8cb659 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:27.505385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15057985-04d6-4e64-869e-7f4bae8cb659 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:27.512180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:27.600293 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 16/34] 10.222.0.36 () {60 vars in 1131 bytes} [Sat Oct 8 20:32:27 2022] POST /identity/v3/roles => generated 219 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:32:27.601296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4a01e-94fe-4bec-83df-3ac409302104 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:27.680240 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 19/35] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Oct 8 20:32:27 2022] POST /identity/v3/projects => generated 301 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:32:27.685926 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c420e5-48a4-4b5c-8994-852d7cb01b1b None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:27.685926 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c420e5-48a4-4b5c-8994-852d7cb01b1b None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:27.685926 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c420e5-48a4-4b5c-8994-852d7cb01b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:27.722376 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-76c420e5-48a4-4b5c-8994-852d7cb01b1b None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:27.725923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-76c420e5-48a4-4b5c-8994-852d7cb01b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:27.728507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:27.778798 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4a01e-94fe-4bec-83df-3ac409302104 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:27.859776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c0b1c-053f-43b8-9cca-cefd60b18912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:27.860696 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c0b1c-053f-43b8-9cca-cefd60b18912 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:27.860976 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c0b1c-053f-43b8-9cca-cefd60b18912 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:27.861249 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c0b1c-053f-43b8-9cca-cefd60b18912 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:27.863290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c0b1c-053f-43b8-9cca-cefd60b18912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:27.865104 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c0b1c-053f-43b8-9cca-cefd60b18912 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:27.868681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 17/36] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:32:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:27.870017 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69cc12-a95c-4a13-ab23-9e31500f8bc1 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:27.870303 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69cc12-a95c-4a13-ab23-9e31500f8bc1 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:27.870576 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69cc12-a95c-4a13-ab23-9e31500f8bc1 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:27.872026 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 18/37] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:27.873079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 20/38] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:27.876653 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69cc12-a95c-4a13-ab23-9e31500f8bc1 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:27.879483 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba6e8d-5dab-48fb-ae9e-f04d7b34c94d None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:27.879782 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba6e8d-5dab-48fb-ae9e-f04d7b34c94d None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:27.880071 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba6e8d-5dab-48fb-ae9e-f04d7b34c94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:27.902224 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-c6ba6e8d-5dab-48fb-ae9e-f04d7b34c94d None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:27.903457 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-c6ba6e8d-5dab-48fb-ae9e-f04d7b34c94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:28.014857 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 21/39] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:28.040621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69cc12-a95c-4a13-ab23-9e31500f8bc1 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:28.059592 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167bce1-953a-401b-9cdf-298483e24ff0 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:28.059873 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167bce1-953a-401b-9cdf-298483e24ff0 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:28.060154 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167bce1-953a-401b-9cdf-298483e24ff0 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:28.061495 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 22/40] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:28.067379 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4e814-4f7b-4446-9a27-813b8e5a5cf2 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:28.067665 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4e814-4f7b-4446-9a27-813b8e5a5cf2 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:28.067945 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4e814-4f7b-4446-9a27-813b8e5a5cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:28.097668 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-9ec4e814-4f7b-4446-9a27-813b8e5a5cf2 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:28.098934 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-9ec4e814-4f7b-4446-9a27-813b8e5a5cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:28.101506 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6129715-a302-4928-848a-1dd1b0e1e953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:28.103392 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6129715-a302-4928-848a-1dd1b0e1e953 None admin] REQUEST_METHOD: `PUT` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:28.103912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6129715-a302-4928-848a-1dd1b0e1e953 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:28.104445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6129715-a302-4928-848a-1dd1b0e1e953 None admin] PATH_INFO: `/v3/domains/default/users/38722554f5ac49c2a9cfb6efcc8e8b54/roles/323ca657fe7b4b878fd8328ef78f29f4` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:28.110718 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6129715-a302-4928-848a-1dd1b0e1e953 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=38722554f5ac49c2a9cfb6efcc8e8b54, role_id=323ca657fe7b4b878fd8328ef78f29f4)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:28.110718 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6129715-a302-4928-848a-1dd1b0e1e953 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:28.132714 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 19/41] 10.222.0.36 () {58 vars in 1361 bytes} [Sat Oct 8 20:32:27 2022] PUT /identity/v3/domains/default/users/38722554f5ac49c2a9cfb6efcc8e8b54/roles/323ca657fe7b4b878fd8328ef78f29f4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:32:28.164332 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:28.194484 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 23/42] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:32:28.305211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6129715-a302-4928-848a-1dd1b0e1e953 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:28.315689 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:28.422055 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6129715-a302-4928-848a-1dd1b0e1e953 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:28.430222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4e814-4f7b-4446-9a27-813b8e5a5cf2 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:28.458179 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d0fde-e5bb-4aa4-af69-2ef0d698ad3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:28.459983 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d0fde-e5bb-4aa4-af69-2ef0d698ad3a None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:28.460417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d0fde-e5bb-4aa4-af69-2ef0d698ad3a None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:28.460835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d0fde-e5bb-4aa4-af69-2ef0d698ad3a None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:28.461661 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d0fde-e5bb-4aa4-af69-2ef0d698ad3a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:28.463751 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d0fde-e5bb-4aa4-af69-2ef0d698ad3a None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:28.485336 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 20/43] 10.222.0.36 () {60 vars in 1131 bytes} [Sat Oct 8 20:32:28 2022] POST /identity/v3/roles => generated 225 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:32:28.541009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d0fde-e5bb-4aa4-af69-2ef0d698ad3a None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:28.573106 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4e814-4f7b-4446-9a27-813b8e5a5cf2 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:28.621060 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:28.625345 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a9aae-3cad-4b72-9b24-04795965eed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:28.626483 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a9aae-3cad-4b72-9b24-04795965eed8 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:28.627243 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a9aae-3cad-4b72-9b24-04795965eed8 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:28.628295 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a9aae-3cad-4b72-9b24-04795965eed8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:28.631923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a9aae-3cad-4b72-9b24-04795965eed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:28.634888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a9aae-3cad-4b72-9b24-04795965eed8 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:28.636607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 24/44] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:32:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:28.643250 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a9aae-3cad-4b72-9b24-04795965eed8 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:28.680780 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d0fde-e5bb-4aa4-af69-2ef0d698ad3a None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:28.700071 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:28.725653 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317de90-557e-4ec9-ad4f-d882d1b88d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:28.726307 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317de90-557e-4ec9-ad4f-d882d1b88d8c None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:28.726593 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317de90-557e-4ec9-ad4f-d882d1b88d8c None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:28.726866 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317de90-557e-4ec9-ad4f-d882d1b88d8c None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:28.727531 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317de90-557e-4ec9-ad4f-d882d1b88d8c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:28.728964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317de90-557e-4ec9-ad4f-d882d1b88d8c None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:28.751650 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 21/45] 10.222.0.36 () {60 vars in 1131 bytes} [Sat Oct 8 20:32:28 2022] POST /identity/v3/roles => generated 223 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:32:28.772660 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a9aae-3cad-4b72-9b24-04795965eed8 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:28.812637 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1c7a2-8482-4c75-9cc6-d969ff8260be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:28.813274 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1c7a2-8482-4c75-9cc6-d969ff8260be None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:28.813564 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1c7a2-8482-4c75-9cc6-d969ff8260be None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:28.813917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1c7a2-8482-4c75-9cc6-d969ff8260be None admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:28.814614 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1c7a2-8482-4c75-9cc6-d969ff8260be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:28.816177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1c7a2-8482-4c75-9cc6-d969ff8260be None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:28.847890 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 25/46] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Oct 8 20:32:28 2022] POST /identity/v3/projects => generated 312 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:32:30.665857 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6280d1b-c9f8-4b38-8b06-97e9db0af3ff None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:30.666392 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6280d1b-c9f8-4b38-8b06-97e9db0af3ff None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:30.666477 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6280d1b-c9f8-4b38-8b06-97e9db0af3ff None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:30.667773 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 22/47] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:30.673080 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e160a5-e18d-4211-bb94-9b97669daa6f None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:30.673498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e160a5-e18d-4211-bb94-9b97669daa6f None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:30.673761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e160a5-e18d-4211-bb94-9b97669daa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:30.693072 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-54e160a5-e18d-4211-bb94-9b97669daa6f None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:30.694993 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-54e160a5-e18d-4211-bb94-9b97669daa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:30.762198 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 26/48] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:31.089238 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6280d1b-c9f8-4b38-8b06-97e9db0af3ff None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:31.189809 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6280d1b-c9f8-4b38-8b06-97e9db0af3ff None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:31.214862 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:31.224076 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e7b4b-500b-4276-ada4-3b58637f91e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:31.224705 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e7b4b-500b-4276-ada4-3b58637f91e0 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:31.224984 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e7b4b-500b-4276-ada4-3b58637f91e0 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:31.225258 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e7b4b-500b-4276-ada4-3b58637f91e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:31.236591 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e7b4b-500b-4276-ada4-3b58637f91e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-d33e7b4b-500b-4276-ada4-3b58637f91e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:31.242847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:31.243886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:31.245094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:31.245094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:31.245094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:31.245094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:31.245094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:31.245094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:31.245094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:31.245094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:31.245094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:31.245094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:31.245094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:32:31.245094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:32:31.245094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 23/49] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:32:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:31.249716 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e160a5-e18d-4211-bb94-9b97669daa6f None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:31.262004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb1e32-391b-4145-bda6-9aee57839b93 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:31.262287 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb1e32-391b-4145-bda6-9aee57839b93 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:31.262555 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb1e32-391b-4145-bda6-9aee57839b93 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:31.263983 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 24/50] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:32:31.268625 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabf8f2-9204-4b33-b2de-9be67bb5731a None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:31.268910 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabf8f2-9204-4b33-b2de-9be67bb5731a None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:31.269189 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabf8f2-9204-4b33-b2de-9be67bb5731a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:31.278168 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:31.288468 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-1dabf8f2-9204-4b33-b2de-9be67bb5731a None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:31.290120 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-1dabf8f2-9204-4b33-b2de-9be67bb5731a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:31.350362 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e160a5-e18d-4211-bb94-9b97669daa6f None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:31.355434 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 25/51] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:32:31.384026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e683dd-d2aa-474d-9cf5-83ef2667aaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:31.384627 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e683dd-d2aa-474d-9cf5-83ef2667aaa3 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:31.384905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e683dd-d2aa-474d-9cf5-83ef2667aaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:31.385175 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e683dd-d2aa-474d-9cf5-83ef2667aaa3 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:31.385823 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e683dd-d2aa-474d-9cf5-83ef2667aaa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:31.386153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e683dd-d2aa-474d-9cf5-83ef2667aaa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:31.387506 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e683dd-d2aa-474d-9cf5-83ef2667aaa3 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:31.400669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 27/52] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:31.401838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabf8f2-9204-4b33-b2de-9be67bb5731a None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:31.497147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabf8f2-9204-4b33-b2de-9be67bb5731a None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:31.512583 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:31.529978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112da231-b6d7-46fc-b6be-2257daff1b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:31.530614 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112da231-b6d7-46fc-b6be-2257daff1b1c None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:31.530895 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112da231-b6d7-46fc-b6be-2257daff1b1c None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:31.531166 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112da231-b6d7-46fc-b6be-2257daff1b1c None admin] PATH_INFO: `/v3/users/38722554f5ac49c2a9cfb6efcc8e8b54` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:31.532275 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112da231-b6d7-46fc-b6be-2257daff1b1c None admin] RBAC: Authorizing `identity:get_user(user_id=38722554f5ac49c2a9cfb6efcc8e8b54)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:31.533695 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112da231-b6d7-46fc-b6be-2257daff1b1c None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:31.535275 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:31 2022] GET /identity/v3/users/38722554f5ac49c2a9cfb6efcc8e8b54 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:31.541291 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e683dd-d2aa-474d-9cf5-83ef2667aaa3 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:31.626407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:31.639019 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e683dd-d2aa-474d-9cf5-83ef2667aaa3 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:31.672415 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d9455-5c12-45da-8db4-3c55bcc8e937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:31.673042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d9455-5c12-45da-8db4-3c55bcc8e937 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:31.673330 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d9455-5c12-45da-8db4-3c55bcc8e937 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:31.673846 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d9455-5c12-45da-8db4-3c55bcc8e937 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:31.674757 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d9455-5c12-45da-8db4-3c55bcc8e937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:31.676186 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d9455-5c12-45da-8db4-3c55bcc8e937 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:31.678252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 28/54] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:32:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:31.683939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112da231-b6d7-46fc-b6be-2257daff1b1c None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:31.685121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d9455-5c12-45da-8db4-3c55bcc8e937 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:31.784841 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d9455-5c12-45da-8db4-3c55bcc8e937 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:31.785850 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112da231-b6d7-46fc-b6be-2257daff1b1c None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:31.817671 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23fb33-5670-4ccc-b77d-3201ef327e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:31.818827 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23fb33-5670-4ccc-b77d-3201ef327e6b None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:31.819109 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23fb33-5670-4ccc-b77d-3201ef327e6b None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:31.819532 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23fb33-5670-4ccc-b77d-3201ef327e6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:31.819737 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c1da1-6349-42d0-902c-a2ad7269aedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:31.820357 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c1da1-6349-42d0-902c-a2ad7269aedb None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:31.820644 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c1da1-6349-42d0-902c-a2ad7269aedb None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:31.820728 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23fb33-5670-4ccc-b77d-3201ef327e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:31.820925 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c1da1-6349-42d0-902c-a2ad7269aedb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:31.821646 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c1da1-6349-42d0-902c-a2ad7269aedb None admin] RBAC: Adding query filter params (role.id=323ca657fe7b4b878fd8328ef78f29f4, scope.domain.id=default, user.id=38722554f5ac49c2a9cfb6efcc8e8b54) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:31.822034 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c1da1-6349-42d0-902c-a2ad7269aedb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:31.822128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23fb33-5670-4ccc-b77d-3201ef327e6b None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:31.823457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c1da1-6349-42d0-902c-a2ad7269aedb None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:31.823629 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 29/55] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:32:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:31.829021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23fb33-5670-4ccc-b77d-3201ef327e6b None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:31.835346 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 27/56] 10.222.0.36 () {56 vars in 1322 bytes} [Sat Oct 8 20:32:31 2022] GET /identity/v3/role_assignments?user.id=38722554f5ac49c2a9cfb6efcc8e8b54&scope.domain.id=default&role.id=323ca657fe7b4b878fd8328ef78f29f4 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:31.858022 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:31.937250 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23fb33-5670-4ccc-b77d-3201ef327e6b None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:31.976582 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6132c-b169-4c9d-94d9-ee5de6d4972d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:31.977212 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6132c-b169-4c9d-94d9-ee5de6d4972d None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:31.977494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6132c-b169-4c9d-94d9-ee5de6d4972d None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:31.977768 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6132c-b169-4c9d-94d9-ee5de6d4972d None admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:31.978483 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6132c-b169-4c9d-94d9-ee5de6d4972d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:31.979945 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6132c-b169-4c9d-94d9-ee5de6d4972d None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:32.011416 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 30/57] 10.222.0.36 () {60 vars in 1140 bytes} [Sat Oct 8 20:32:31 2022] POST /identity/v3/projects => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:32:34.388925 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f21c1c-ef9d-4f16-8eb5-7185262cbcb1 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:34.389412 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f21c1c-ef9d-4f16-8eb5-7185262cbcb1 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:34.389412 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f21c1c-ef9d-4f16-8eb5-7185262cbcb1 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:34.390739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 28/58] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:34.395785 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e731-8515-40d1-a5e1-7be61b6324f6 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:34.396188 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e731-8515-40d1-a5e1-7be61b6324f6 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:34.396844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e731-8515-40d1-a5e1-7be61b6324f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:34.415043 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-a783e731-8515-40d1-a5e1-7be61b6324f6 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:34.416223 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-a783e731-8515-40d1-a5e1-7be61b6324f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:34.480647 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 31/59] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:34.803100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f21c1c-ef9d-4f16-8eb5-7185262cbcb1 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:34.852494 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:34.903071 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f21c1c-ef9d-4f16-8eb5-7185262cbcb1 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:34.934973 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b738c-bdbe-49a7-a114-6776905f9eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:34.935599 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b738c-bdbe-49a7-a114-6776905f9eca None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:34.935886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b738c-bdbe-49a7-a114-6776905f9eca None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:34.936161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b738c-bdbe-49a7-a114-6776905f9eca None admin] PATH_INFO: `/v3/domains/default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:34.937264 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b738c-bdbe-49a7-a114-6776905f9eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:34.938717 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b738c-bdbe-49a7-a114-6776905f9eca None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:34.940263 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 29/60] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:32:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:34.946359 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783e731-8515-40d1-a5e1-7be61b6324f6 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:34.954229 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:35.043731 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783e731-8515-40d1-a5e1-7be61b6324f6 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:35.077959 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af4f88-a8b0-4bf4-bc10-b4259c3189ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:35.078564 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af4f88-a8b0-4bf4-bc10-b4259c3189ca None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:35.078842 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af4f88-a8b0-4bf4-bc10-b4259c3189ca None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:35.079116 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af4f88-a8b0-4bf4-bc10-b4259c3189ca None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:35.079754 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af4f88-a8b0-4bf4-bc10-b4259c3189ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:35.081171 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af4f88-a8b0-4bf4-bc10-b4259c3189ca None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:35.107140 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 32/61] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Oct 8 20:32:34 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:32:38.832210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62354de-f4ac-48cd-a007-046cfc60835e None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:38.833230 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62354de-f4ac-48cd-a007-046cfc60835e None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:38.834343 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62354de-f4ac-48cd-a007-046cfc60835e None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:38.836219 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 30/62] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:38.841812 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25052b-8837-4f51-bee3-4d1eff251e1d None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:38.842744 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25052b-8837-4f51-bee3-4d1eff251e1d None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:38.843236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25052b-8837-4f51-bee3-4d1eff251e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:38.869675 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-9a25052b-8837-4f51-bee3-4d1eff251e1d None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:38.871220 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-9a25052b-8837-4f51-bee3-4d1eff251e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:38.898945 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a36e5-3b35-468e-96d9-134866b663df None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:38.899604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a36e5-3b35-468e-96d9-134866b663df None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:38.900084 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a36e5-3b35-468e-96d9-134866b663df None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:38.901621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:38.907286 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280795e-5249-4be3-9ad1-27ddafa25f5d None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:38.907838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280795e-5249-4be3-9ad1-27ddafa25f5d None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:38.908436 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280795e-5249-4be3-9ad1-27ddafa25f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:38.940624 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-b280795e-5249-4be3-9ad1-27ddafa25f5d None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:38.943049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-b280795e-5249-4be3-9ad1-27ddafa25f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:39.015345 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:39.034113 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 33/64] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:39.053620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 32/65] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:32:39.076255 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47417d26-64d2-46f9-b41b-9dbf6593b13e None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:39.076574 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47417d26-64d2-46f9-b41b-9dbf6593b13e None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:39.076841 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47417d26-64d2-46f9-b41b-9dbf6593b13e None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:39.078222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 34/66] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:39.084479 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa2fbe-fdb3-49ce-aa91-ffcc4be6d451 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:39.084649 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa2fbe-fdb3-49ce-aa91-ffcc4be6d451 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:39.084912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa2fbe-fdb3-49ce-aa91-ffcc4be6d451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:39.115389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-ccaa2fbe-fdb3-49ce-aa91-ffcc4be6d451 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:39.116594 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-ccaa2fbe-fdb3-49ce-aa91-ffcc4be6d451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:39.163324 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:39.192317 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd95d0d-0e0f-487e-a2d9-4eb0ebf7e588 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:39.192616 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd95d0d-0e0f-487e-a2d9-4eb0ebf7e588 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:39.192867 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd95d0d-0e0f-487e-a2d9-4eb0ebf7e588 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:39.194686 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 35/67] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:39.200683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281642a-f0b9-4fdc-a0e7-769ad4cf897b None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:39.200991 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281642a-f0b9-4fdc-a0e7-769ad4cf897b None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:39.201237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281642a-f0b9-4fdc-a0e7-769ad4cf897b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:39.225998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 33/68] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:39.238902 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-5281642a-f0b9-4fdc-a0e7-769ad4cf897b None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:39.240275 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-5281642a-f0b9-4fdc-a0e7-769ad4cf897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:39.335878 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 36/69] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:32:39.439982 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf90bf-0909-4440-8f16-2c8d005e157a None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:39.440341 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf90bf-0909-4440-8f16-2c8d005e157a None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:39.440546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf90bf-0909-4440-8f16-2c8d005e157a None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:39.441904 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 34/70] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:39.447880 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29794c5b-1e8a-407a-8790-d5f5c28331fb None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:39.448390 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29794c5b-1e8a-407a-8790-d5f5c28331fb None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:39.448871 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29794c5b-1e8a-407a-8790-d5f5c28331fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:39.471512 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-29794c5b-1e8a-407a-8790-d5f5c28331fb None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:39.473003 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-29794c5b-1e8a-407a-8790-d5f5c28331fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:39.483423 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf90bf-0909-4440-8f16-2c8d005e157a None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:39.563517 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 37/71] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:39.564191 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29794c5b-1e8a-407a-8790-d5f5c28331fb None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:39.627229 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf90bf-0909-4440-8f16-2c8d005e157a None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:39.629591 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:39.662584 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27483d63-b2fd-47c4-8647-262a34ae27e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:39.663222 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27483d63-b2fd-47c4-8647-262a34ae27e3 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:39.663504 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27483d63-b2fd-47c4-8647-262a34ae27e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:39.663784 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27483d63-b2fd-47c4-8647-262a34ae27e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:39.674071 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27483d63-b2fd-47c4-8647-262a34ae27e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-27483d63-b2fd-47c4-8647-262a34ae27e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:39.679013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:39.679900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:39.680731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:39.680731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:39.680731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:39.680731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:39.680731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:39.680731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:39.680731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:39.680731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:39.680731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:39.680731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:39.680731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:32:39.680731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:32:39.684917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 35/72] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:39.685804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27483d63-b2fd-47c4-8647-262a34ae27e3 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:39.688774 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29794c5b-1e8a-407a-8790-d5f5c28331fb None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:39.723322 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:39.732672 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52445e27-2dab-48c4-8bd4-f70fc9fa94d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:39.733545 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52445e27-2dab-48c4-8bd4-f70fc9fa94d6 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:39.734030 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52445e27-2dab-48c4-8bd4-f70fc9fa94d6 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:39.734461 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52445e27-2dab-48c4-8bd4-f70fc9fa94d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:39.745985 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52445e27-2dab-48c4-8bd4-f70fc9fa94d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-52445e27-2dab-48c4-8bd4-f70fc9fa94d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:39.750817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:39.751893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:39.752831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:39.752831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:39.752831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:39.752831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:39.752831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:39.752831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:39.752831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:39.752831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:39.752831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:39.752831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:39.752831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:32:39.752831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:32:39.752831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 38/73] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:39.752831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52445e27-2dab-48c4-8bd4-f70fc9fa94d6 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:39.798262 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27483d63-b2fd-47c4-8647-262a34ae27e3 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:39.832068 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4d6f8-f950-4559-822b-4a8bc7dcfa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:39.832703 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4d6f8-f950-4559-822b-4a8bc7dcfa4a None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:39.833260 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4d6f8-f950-4559-822b-4a8bc7dcfa4a None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:39.833260 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4d6f8-f950-4559-822b-4a8bc7dcfa4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:39.844070 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4d6f8-f950-4559-822b-4a8bc7dcfa4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-4ac4d6f8-f950-4559-822b-4a8bc7dcfa4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:39.848863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:39.850580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:39.851356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:39.851356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:39.851356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:39.851356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:39.851356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:39.851356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:39.851356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:39.851356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:39.851356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:39.851356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:39.851356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:32:39.851356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:32:39.851356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 36/74] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:39.851356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4d6f8-f950-4559-822b-4a8bc7dcfa4a None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:39.862749 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52445e27-2dab-48c4-8bd4-f70fc9fa94d6 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:39.876560 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:39.903937 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ca3dc-6ce8-4aa3-b474-5a626a2e0bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:39.904815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ca3dc-6ce8-4aa3-b474-5a626a2e0bdc None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:39.905356 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ca3dc-6ce8-4aa3-b474-5a626a2e0bdc None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:39.905639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ca3dc-6ce8-4aa3-b474-5a626a2e0bdc None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:39.906475 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ca3dc-6ce8-4aa3-b474-5a626a2e0bdc None admin] RBAC: Adding query filter params (name=member) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:39.906789 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ca3dc-6ce8-4aa3-b474-5a626a2e0bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:39.908541 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ca3dc-6ce8-4aa3-b474-5a626a2e0bdc None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:39.917362 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 39/75] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:32:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:39.918187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ca3dc-6ce8-4aa3-b474-5a626a2e0bdc None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:39.954223 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:39.960795 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4d6f8-f950-4559-822b-4a8bc7dcfa4a None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:39.996572 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974b2fc-ef6d-42cf-b504-d82467133b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:39.997418 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b2fc-ef6d-42cf-b504-d82467133b07 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:39.997690 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b2fc-ef6d-42cf-b504-d82467133b07 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:39.997990 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b2fc-ef6d-42cf-b504-d82467133b07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:40.009160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974b2fc-ef6d-42cf-b504-d82467133b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-c974b2fc-ef6d-42cf-b504-d82467133b07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:40.014047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:40.015088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:40.016025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:40.016025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:40.016025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:40.016025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:40.016025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:40.016025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:40.016025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:40.016025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:40.016025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:40.016025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:40.016025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:32:40.016025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:32:40.016025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 37/76] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:32:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:40.016025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974b2fc-ef6d-42cf-b504-d82467133b07 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:40.026902 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ca3dc-6ce8-4aa3-b474-5a626a2e0bdc None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:40.062003 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c52cc4-e57e-4274-a5d3-7a928a7736ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:40.062614 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c52cc4-e57e-4274-a5d3-7a928a7736ed None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:40.062898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c52cc4-e57e-4274-a5d3-7a928a7736ed None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:40.063177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c52cc4-e57e-4274-a5d3-7a928a7736ed None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:40.063845 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c52cc4-e57e-4274-a5d3-7a928a7736ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:40.064153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c52cc4-e57e-4274-a5d3-7a928a7736ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:40.065525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c52cc4-e57e-4274-a5d3-7a928a7736ed None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:40.073486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 40/77] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:40.074304 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c52cc4-e57e-4274-a5d3-7a928a7736ed None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:40.111710 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:40.117590 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974b2fc-ef6d-42cf-b504-d82467133b07 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:40.150747 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f51e8-bb7b-45e7-b5bf-e719c1cc3ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:40.151352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f51e8-bb7b-45e7-b5bf-e719c1cc3ef0 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:40.151632 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f51e8-bb7b-45e7-b5bf-e719c1cc3ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:40.151907 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f51e8-bb7b-45e7-b5bf-e719c1cc3ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:40.152561 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f51e8-bb7b-45e7-b5bf-e719c1cc3ef0 None admin] RBAC: Adding query filter params (name=member) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:40.152862 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f51e8-bb7b-45e7-b5bf-e719c1cc3ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:40.154325 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f51e8-bb7b-45e7-b5bf-e719c1cc3ef0 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:40.166157 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 38/78] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:32:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:40.167015 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f51e8-bb7b-45e7-b5bf-e719c1cc3ef0 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:40.183608 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c52cc4-e57e-4274-a5d3-7a928a7736ed None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:40.185394 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:40.216661 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23a57-21ae-45f4-8d32-b716e77116f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:40.217287 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23a57-21ae-45f4-8d32-b716e77116f3 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:40.217567 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23a57-21ae-45f4-8d32-b716e77116f3 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:40.217840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23a57-21ae-45f4-8d32-b716e77116f3 None admin] PATH_INFO: `/v3/users/0b29cea55e144cb6a1feea5fe876a199` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:40.231449 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23a57-21ae-45f4-8d32-b716e77116f3 None admin] RBAC: Authorizing `identity:get_user(user_id=0b29cea55e144cb6a1feea5fe876a199)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:40.232894 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23a57-21ae-45f4-8d32-b716e77116f3 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:40.234581 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 41/79] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:40 2022] GET /identity/v3/users/0b29cea55e144cb6a1feea5fe876a199 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:40.235598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23a57-21ae-45f4-8d32-b716e77116f3 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:40.268683 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f51e8-bb7b-45e7-b5bf-e719c1cc3ef0 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:40.301199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988d358-a0b8-4c9f-b2c8-76302c8ebda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:40.301826 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988d358-a0b8-4c9f-b2c8-76302c8ebda3 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:40.302132 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988d358-a0b8-4c9f-b2c8-76302c8ebda3 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:40.302980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988d358-a0b8-4c9f-b2c8-76302c8ebda3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:40.304083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988d358-a0b8-4c9f-b2c8-76302c8ebda3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:40.305509 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988d358-a0b8-4c9f-b2c8-76302c8ebda3 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:40.307096 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 39/80] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:32:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:40.307853 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988d358-a0b8-4c9f-b2c8-76302c8ebda3 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:40.327154 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:40.334855 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23a57-21ae-45f4-8d32-b716e77116f3 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:40.368878 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0383ce-3b6d-4476-a489-7d82bdb746ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:40.369480 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0383ce-3b6d-4476-a489-7d82bdb746ad None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:40.369763 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0383ce-3b6d-4476-a489-7d82bdb746ad None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:40.370070 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0383ce-3b6d-4476-a489-7d82bdb746ad None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:40.370733 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0383ce-3b6d-4476-a489-7d82bdb746ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:40.371040 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0383ce-3b6d-4476-a489-7d82bdb746ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:40.372400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0383ce-3b6d-4476-a489-7d82bdb746ad None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:40.380035 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 42/81] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:32:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:40.384922 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0383ce-3b6d-4476-a489-7d82bdb746ad None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:40.390739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:40.406288 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988d358-a0b8-4c9f-b2c8-76302c8ebda3 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:40.439797 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb592c64-cb97-443c-acfd-647002e6ae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:40.440429 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb592c64-cb97-443c-acfd-647002e6ae19 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:40.440714 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb592c64-cb97-443c-acfd-647002e6ae19 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:40.440989 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb592c64-cb97-443c-acfd-647002e6ae19 None admin] PATH_INFO: `/v3/users/38722554f5ac49c2a9cfb6efcc8e8b54` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:40.442154 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb592c64-cb97-443c-acfd-647002e6ae19 None admin] RBAC: Authorizing `identity:get_user(user_id=38722554f5ac49c2a9cfb6efcc8e8b54)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:40.443609 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb592c64-cb97-443c-acfd-647002e6ae19 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:40.445168 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 40/82] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:40 2022] GET /identity/v3/users/38722554f5ac49c2a9cfb6efcc8e8b54 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:40.449788 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb592c64-cb97-443c-acfd-647002e6ae19 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:40.480537 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0383ce-3b6d-4476-a489-7d82bdb746ad None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:40.513621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed672d1-3921-4639-926d-4d178eaeb0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:40.514271 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed672d1-3921-4639-926d-4d178eaeb0ed None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:40.514552 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed672d1-3921-4639-926d-4d178eaeb0ed None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:40.514828 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed672d1-3921-4639-926d-4d178eaeb0ed None admin] PATH_INFO: `/v3/users/0b29cea55e144cb6a1feea5fe876a199` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:40.515928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed672d1-3921-4639-926d-4d178eaeb0ed None admin] RBAC: Authorizing `identity:get_user(user_id=0b29cea55e144cb6a1feea5fe876a199)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:40.517351 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed672d1-3921-4639-926d-4d178eaeb0ed None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:40.519088 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 43/83] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:40 2022] GET /identity/v3/users/0b29cea55e144cb6a1feea5fe876a199 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:40.519734 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed672d1-3921-4639-926d-4d178eaeb0ed None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:40.543778 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:40.547336 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb592c64-cb97-443c-acfd-647002e6ae19 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:40.583845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81671d9-5cd8-4009-8110-28df7ff1dd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:40.584457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81671d9-5cd8-4009-8110-28df7ff1dd0e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:40.584741 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81671d9-5cd8-4009-8110-28df7ff1dd0e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:40.585018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81671d9-5cd8-4009-8110-28df7ff1dd0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:40.608170 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:40.616399 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed672d1-3921-4639-926d-4d178eaeb0ed None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:40.649601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a19118-2f3f-4cf2-b2ec-bf608a2fb119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:40.650323 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a19118-2f3f-4cf2-b2ec-bf608a2fb119 None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:40.650681 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a19118-2f3f-4cf2-b2ec-bf608a2fb119 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:40.650968 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a19118-2f3f-4cf2-b2ec-bf608a2fb119 None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:40.651619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a19118-2f3f-4cf2-b2ec-bf608a2fb119 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:40.653056 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a19118-2f3f-4cf2-b2ec-bf608a2fb119 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:40.653597 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81671d9-5cd8-4009-8110-28df7ff1dd0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:40.655086 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81671d9-5cd8-4009-8110-28df7ff1dd0e None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:40.673914 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 44/84] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Oct 8 20:32:40 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:32:40.674944 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a19118-2f3f-4cf2-b2ec-bf608a2fb119 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:40.762373 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:40.772930 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 41/85] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:32:40.779284 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81671d9-5cd8-4009-8110-28df7ff1dd0e None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:40.783169 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a19118-2f3f-4cf2-b2ec-bf608a2fb119 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:40.818953 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0e958-0188-43e9-87f9-3c61ead1fce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:40.819610 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0e958-0188-43e9-87f9-3c61ead1fce9 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:40.819896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0e958-0188-43e9-87f9-3c61ead1fce9 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:40.820173 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0e958-0188-43e9-87f9-3c61ead1fce9 None admin] PATH_INFO: `/v3/users/0b29cea55e144cb6a1feea5fe876a199` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:40.821402 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0e958-0188-43e9-87f9-3c61ead1fce9 None admin] RBAC: Authorizing `identity:get_user(user_id=0b29cea55e144cb6a1feea5fe876a199)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:40.822961 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0e958-0188-43e9-87f9-3c61ead1fce9 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:40.824708 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 45/86] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:40 2022] GET /identity/v3/users/0b29cea55e144cb6a1feea5fe876a199 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:40.826959 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0e958-0188-43e9-87f9-3c61ead1fce9 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:40.847007 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:40.909001 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81671d9-5cd8-4009-8110-28df7ff1dd0e None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:40.946792 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0e958-0188-43e9-87f9-3c61ead1fce9 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:40.952089 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6939a7-1b40-401d-a014-e001fa92a425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:40.952725 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6939a7-1b40-401d-a014-e001fa92a425 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:40.952995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6939a7-1b40-401d-a014-e001fa92a425 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:40.953272 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6939a7-1b40-401d-a014-e001fa92a425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:40.990340 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f181fd-c22b-4a3e-b2a5-2a0005f332b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:40.991050 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f181fd-c22b-4a3e-b2a5-2a0005f332b8 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:40.991339 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f181fd-c22b-4a3e-b2a5-2a0005f332b8 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:40.991736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f181fd-c22b-4a3e-b2a5-2a0005f332b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:41.013436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:41.040649 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6939a7-1b40-401d-a014-e001fa92a425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:41.042192 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6939a7-1b40-401d-a014-e001fa92a425 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:41.077352 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f181fd-c22b-4a3e-b2a5-2a0005f332b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:41.079349 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f181fd-c22b-4a3e-b2a5-2a0005f332b8 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:41.120942 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:41.175429 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 42/87] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:32:41.176762 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6939a7-1b40-401d-a014-e001fa92a425 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:41.196320 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 46/88] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:32:41.197314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f181fd-c22b-4a3e-b2a5-2a0005f332b8 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:41.255870 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:41.295484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6939a7-1b40-401d-a014-e001fa92a425 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:41.313168 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f181fd-c22b-4a3e-b2a5-2a0005f332b8 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:41.332878 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1aced-7987-4d62-af2a-816da5fe380c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:41.334143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1aced-7987-4d62-af2a-816da5fe380c None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:41.334423 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1aced-7987-4d62-af2a-816da5fe380c None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:41.334701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1aced-7987-4d62-af2a-816da5fe380c None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:41.335866 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1aced-7987-4d62-af2a-816da5fe380c None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:41.337597 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1aced-7987-4d62-af2a-816da5fe380c None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:41.343888 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 43/89] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:41 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:41.343888 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1aced-7987-4d62-af2a-816da5fe380c None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:41.357586 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158778e-f5c2-495b-90d8-0fbdbfa230bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:41.360468 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158778e-f5c2-495b-90d8-0fbdbfa230bc None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:41.361032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158778e-f5c2-495b-90d8-0fbdbfa230bc None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:41.361539 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158778e-f5c2-495b-90d8-0fbdbfa230bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:41.366991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:41.451497 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158778e-f5c2-495b-90d8-0fbdbfa230bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:41.453052 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158778e-f5c2-495b-90d8-0fbdbfa230bc None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:41.456797 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1aced-7987-4d62-af2a-816da5fe380c None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:41.494106 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b625b5-d908-44ee-b8af-0b79ed81bcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:41.495236 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b625b5-d908-44ee-b8af-0b79ed81bcd3 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:41.495709 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b625b5-d908-44ee-b8af-0b79ed81bcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:41.496215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b625b5-d908-44ee-b8af-0b79ed81bcd3 None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:41.497753 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b625b5-d908-44ee-b8af-0b79ed81bcd3 None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:41.499429 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b625b5-d908-44ee-b8af-0b79ed81bcd3 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:41.501362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 44/90] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:41 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:41.502573 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b625b5-d908-44ee-b8af-0b79ed81bcd3 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:41.511250 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:41.570047 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 47/91] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:32:41.571521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158778e-f5c2-495b-90d8-0fbdbfa230bc None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:41.614183 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:41.626712 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b625b5-d908-44ee-b8af-0b79ed81bcd3 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:41.669659 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0a880-11fa-40cd-aed9-788b58030f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:41.670349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0a880-11fa-40cd-aed9-788b58030f4f None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:41.670635 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0a880-11fa-40cd-aed9-788b58030f4f None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:41.670917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0a880-11fa-40cd-aed9-788b58030f4f None admin] PATH_INFO: `/v3/projects/b5ce6afbb1ce40de9740926e6cff5b0c` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:41.672069 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0a880-11fa-40cd-aed9-788b58030f4f None admin] RBAC: Authorizing `identity:get_project(project_id=b5ce6afbb1ce40de9740926e6cff5b0c)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:41.674239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0a880-11fa-40cd-aed9-788b58030f4f None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:41.676053 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 45/92] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:41 2022] GET /identity/v3/projects/b5ce6afbb1ce40de9740926e6cff5b0c => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:41.678420 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0a880-11fa-40cd-aed9-788b58030f4f None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:41.690544 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158778e-f5c2-495b-90d8-0fbdbfa230bc None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:41.729085 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd2e2e-79cb-4776-86ea-b76df9b79168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:41.730095 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd2e2e-79cb-4776-86ea-b76df9b79168 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:41.730665 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd2e2e-79cb-4776-86ea-b76df9b79168 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:41.731128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd2e2e-79cb-4776-86ea-b76df9b79168 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:41.732032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd2e2e-79cb-4776-86ea-b76df9b79168 None admin] RBAC: Adding query filter params (role.id=fc58707301804afca34ac8fe194639ed, scope.project.id=eaae93f262bf474db3770d3977f5e228, user.id=0b29cea55e144cb6a1feea5fe876a199) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:41.732602 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd2e2e-79cb-4776-86ea-b76df9b79168 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:41.734396 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd2e2e-79cb-4776-86ea-b76df9b79168 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:41.741509 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 48/93] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:32:41 2022] GET /identity/v3/role_assignments?user.id=0b29cea55e144cb6a1feea5fe876a199&scope.project.id=eaae93f262bf474db3770d3977f5e228&role.id=fc58707301804afca34ac8fe194639ed => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:41.743745 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd2e2e-79cb-4776-86ea-b76df9b79168 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:41.782258 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:41.799159 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0a880-11fa-40cd-aed9-788b58030f4f None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:41.838420 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97b434-aa6c-4dc0-ba69-08b5f009f306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:41.839054 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97b434-aa6c-4dc0-ba69-08b5f009f306 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:41.839537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97b434-aa6c-4dc0-ba69-08b5f009f306 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:41.839835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97b434-aa6c-4dc0-ba69-08b5f009f306 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:41.840577 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97b434-aa6c-4dc0-ba69-08b5f009f306 None admin] RBAC: Adding query filter params (role.id=323ca657fe7b4b878fd8328ef78f29f4, scope.project.id=eaae93f262bf474db3770d3977f5e228, user.id=38722554f5ac49c2a9cfb6efcc8e8b54) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:41.840895 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97b434-aa6c-4dc0-ba69-08b5f009f306 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:41.842478 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97b434-aa6c-4dc0-ba69-08b5f009f306 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:41.849569 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 46/94] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:32:41 2022] GET /identity/v3/role_assignments?user.id=38722554f5ac49c2a9cfb6efcc8e8b54&scope.project.id=eaae93f262bf474db3770d3977f5e228&role.id=323ca657fe7b4b878fd8328ef78f29f4 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:41.850634 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97b434-aa6c-4dc0-ba69-08b5f009f306 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:41.884324 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:41.973529 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97b434-aa6c-4dc0-ba69-08b5f009f306 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:42.016482 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f2224-db5d-4300-9bcd-fa4e2038f46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:42.017101 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f2224-db5d-4300-9bcd-fa4e2038f46e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:42.017393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f2224-db5d-4300-9bcd-fa4e2038f46e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:42.017672 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f2224-db5d-4300-9bcd-fa4e2038f46e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:42.018465 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f2224-db5d-4300-9bcd-fa4e2038f46e None admin] RBAC: Adding query filter params (role.id=fc58707301804afca34ac8fe194639ed, scope.project.id=b5ce6afbb1ce40de9740926e6cff5b0c, user.id=0b29cea55e144cb6a1feea5fe876a199) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:42.018786 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f2224-db5d-4300-9bcd-fa4e2038f46e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:42.020941 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f2224-db5d-4300-9bcd-fa4e2038f46e None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:42.028197 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 47/95] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:32:41 2022] GET /identity/v3/role_assignments?user.id=0b29cea55e144cb6a1feea5fe876a199&scope.project.id=b5ce6afbb1ce40de9740926e6cff5b0c&role.id=fc58707301804afca34ac8fe194639ed => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:42.106596 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd2e2e-79cb-4776-86ea-b76df9b79168 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:42.168689 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34422498-8260-45e7-beb5-cddfacd9b2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:42.169771 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34422498-8260-45e7-beb5-cddfacd9b2f7 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:42.170298 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34422498-8260-45e7-beb5-cddfacd9b2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:42.170784 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34422498-8260-45e7-beb5-cddfacd9b2f7 None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:42.173842 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34422498-8260-45e7-beb5-cddfacd9b2f7 None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:42.175728 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34422498-8260-45e7-beb5-cddfacd9b2f7 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:42.178736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 49/96] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:41 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:42.184334 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f2224-db5d-4300-9bcd-fa4e2038f46e None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:42.299972 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:42.319626 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f2224-db5d-4300-9bcd-fa4e2038f46e None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:42.361899 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf518845-5300-4811-9124-a9149d4ae877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:42.362534 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518845-5300-4811-9124-a9149d4ae877 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:42.362816 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518845-5300-4811-9124-a9149d4ae877 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:42.363090 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518845-5300-4811-9124-a9149d4ae877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:42.363826 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf518845-5300-4811-9124-a9149d4ae877 None admin] RBAC: Adding query filter params (role.id=04e5ea25342a4845b0df239f7f2b0705, scope.project.id=eaae93f262bf474db3770d3977f5e228, user.id=0b29cea55e144cb6a1feea5fe876a199) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:42.364140 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf518845-5300-4811-9124-a9149d4ae877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:42.365982 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf518845-5300-4811-9124-a9149d4ae877 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:42.371973 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 48/97] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:32:42 2022] GET /identity/v3/role_assignments?user.id=0b29cea55e144cb6a1feea5fe876a199&scope.project.id=eaae93f262bf474db3770d3977f5e228&role.id=04e5ea25342a4845b0df239f7f2b0705 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:43.952308 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd361d9-df35-4c05-b69f-0ba63412231a None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:43.953379 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd361d9-df35-4c05-b69f-0ba63412231a None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:43.953873 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd361d9-df35-4c05-b69f-0ba63412231a None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:43.957087 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 50/98] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:43.963003 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a239a19-49b3-47e1-9694-3a96064adbe9 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:43.964020 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a239a19-49b3-47e1-9694-3a96064adbe9 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:43.964481 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a239a19-49b3-47e1-9694-3a96064adbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:43.995177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-5a239a19-49b3-47e1-9694-3a96064adbe9 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:43.996429 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-5a239a19-49b3-47e1-9694-3a96064adbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:44.116067 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828aace-848b-4edd-80a5-0b32fc2cc18d None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:44.116362 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828aace-848b-4edd-80a5-0b32fc2cc18d None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:44.116707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828aace-848b-4edd-80a5-0b32fc2cc18d None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:44.121484 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 51/99] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:44.133808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795d7c7-bc36-49b8-a002-85dc57e1de85 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:44.133808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795d7c7-bc36-49b8-a002-85dc57e1de85 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:44.133808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795d7c7-bc36-49b8-a002-85dc57e1de85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:44.163546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 49/100] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:44.178958 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-6795d7c7-bc36-49b8-a002-85dc57e1de85 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:44.180156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-6795d7c7-bc36-49b8-a002-85dc57e1de85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:44.282248 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 52/101] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:44.722108 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a239a19-49b3-47e1-9694-3a96064adbe9 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:44.822803 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:44.843629 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a239a19-49b3-47e1-9694-3a96064adbe9 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:44.880221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f4a52-eb87-4bcc-a0c2-8849ae64b82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:44.881103 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f4a52-eb87-4bcc-a0c2-8849ae64b82f None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:44.881389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f4a52-eb87-4bcc-a0c2-8849ae64b82f None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:44.881663 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f4a52-eb87-4bcc-a0c2-8849ae64b82f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:44.892421 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f4a52-eb87-4bcc-a0c2-8849ae64b82f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-7b8f4a52-eb87-4bcc-a0c2-8849ae64b82f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:44.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:44.898960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:44.899750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:44.899750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:44.899750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:44.899750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:44.899750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:44.899750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:44.899750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:44.899750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:44.899750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:44.899750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:44.899750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:32:44.899750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:32:44.899750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 50/102] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:44.904966 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795d7c7-bc36-49b8-a002-85dc57e1de85 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:44.921515 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:44.962068 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f4a52-eb87-4bcc-a0c2-8849ae64b82f None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:45.093770 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795d7c7-bc36-49b8-a002-85dc57e1de85 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:45.157366 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548e017-c5ba-4cd3-861d-e6e3c6128ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:45.158030 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548e017-c5ba-4cd3-861d-e6e3c6128ccd None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:45.158180 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f4a52-eb87-4bcc-a0c2-8849ae64b82f None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:45.158605 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548e017-c5ba-4cd3-861d-e6e3c6128ccd None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:45.158605 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548e017-c5ba-4cd3-861d-e6e3c6128ccd None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:45.159294 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548e017-c5ba-4cd3-861d-e6e3c6128ccd None admin] RBAC: Adding query filter params (name=reader) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:45.159603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548e017-c5ba-4cd3-861d-e6e3c6128ccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:45.161217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548e017-c5ba-4cd3-861d-e6e3c6128ccd None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:45.180146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 53/103] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:32:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:45.186809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548e017-c5ba-4cd3-861d-e6e3c6128ccd None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:45.221848 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8d09c-0098-4a6d-bb8c-c357f9487a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:45.222565 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8d09c-0098-4a6d-bb8c-c357f9487a5a None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:45.222854 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8d09c-0098-4a6d-bb8c-c357f9487a5a None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:45.223233 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8d09c-0098-4a6d-bb8c-c357f9487a5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:45.226635 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8d09c-0098-4a6d-bb8c-c357f9487a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:45.228077 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8d09c-0098-4a6d-bb8c-c357f9487a5a None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:45.230587 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 51/104] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:32:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:32:45.236290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8d09c-0098-4a6d-bb8c-c357f9487a5a None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:45.262263 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:45.305504 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:45.358228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548e017-c5ba-4cd3-861d-e6e3c6128ccd None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:45.411831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85f8ef-6f19-4bc9-b4aa-71886cb7ed05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:45.412620 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85f8ef-6f19-4bc9-b4aa-71886cb7ed05 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:45.412904 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85f8ef-6f19-4bc9-b4aa-71886cb7ed05 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:45.413194 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85f8ef-6f19-4bc9-b4aa-71886cb7ed05 None admin] PATH_INFO: `/v3/users/124e4e6398714d77a9c227d178de887f` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:45.435506 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85f8ef-6f19-4bc9-b4aa-71886cb7ed05 None admin] RBAC: Authorizing `identity:get_user(user_id=124e4e6398714d77a9c227d178de887f)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:45.437860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85f8ef-6f19-4bc9-b4aa-71886cb7ed05 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:45.439356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8d09c-0098-4a6d-bb8c-c357f9487a5a None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:45.439802 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 54/105] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:45 2022] GET /identity/v3/users/124e4e6398714d77a9c227d178de887f => generated 289 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:32:45.440964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6b233-3de0-4579-9728-d8466d2355ac None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:45.441260 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6b233-3de0-4579-9728-d8466d2355ac None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:45.446059 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6b233-3de0-4579-9728-d8466d2355ac None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:45.447533 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 55/106] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:45.448605 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c6329-1cb5-4ee3-bb75-3c6ab8c11101 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:45.448894 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c6329-1cb5-4ee3-bb75-3c6ab8c11101 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:45.449238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c6329-1cb5-4ee3-bb75-3c6ab8c11101 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:45.450547 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 56/107] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:45.452144 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c6329-1cb5-4ee3-bb75-3c6ab8c11101 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:45.485363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168473d-9616-46a7-86d2-e68dbdc44e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:45.486108 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168473d-9616-46a7-86d2-e68dbdc44e53 None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:45.486391 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168473d-9616-46a7-86d2-e68dbdc44e53 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:45.486781 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168473d-9616-46a7-86d2-e68dbdc44e53 None admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:45.487568 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168473d-9616-46a7-86d2-e68dbdc44e53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:45.489003 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168473d-9616-46a7-86d2-e68dbdc44e53 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:45.524607 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 52/108] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Oct 8 20:32:45 2022] POST /identity/v3/projects => generated 302 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:32:45.531789 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd91bc-3a77-4d5c-9b7c-d7c68f375f74 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:45.532455 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd91bc-3a77-4d5c-9b7c-d7c68f375f74 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:45.532948 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd91bc-3a77-4d5c-9b7c-d7c68f375f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:45.568831 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-1cdd91bc-3a77-4d5c-9b7c-d7c68f375f74 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:45.570457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-1cdd91bc-3a77-4d5c-9b7c-d7c68f375f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:45.605820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c6329-1cb5-4ee3-bb75-3c6ab8c11101 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:45.665623 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:45.676472 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb76d51-29df-4764-b832-24edf3a06d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:45.678291 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb76d51-29df-4764-b832-24edf3a06d88 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:45.679402 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb76d51-29df-4764-b832-24edf3a06d88 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:45.679691 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb76d51-29df-4764-b832-24edf3a06d88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:45.689183 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:45.705318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 53/109] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:45.707094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88607cb-3242-4834-a2bc-4b996856cab8 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:45.707572 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88607cb-3242-4834-a2bc-4b996856cab8 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:45.708061 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88607cb-3242-4834-a2bc-4b996856cab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:45.729521 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-d88607cb-3242-4834-a2bc-4b996856cab8 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:45.732213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-d88607cb-3242-4834-a2bc-4b996856cab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:45.780202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb76d51-29df-4764-b832-24edf3a06d88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:45.782106 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb76d51-29df-4764-b832-24edf3a06d88 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:45.836494 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 54/110] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:45.837859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab620b66-7556-43e1-aaed-ed78427ac349 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:45.838211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab620b66-7556-43e1-aaed-ed78427ac349 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:45.838489 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab620b66-7556-43e1-aaed-ed78427ac349 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:45.844734 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 55/111] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:45.848875 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32568e35-6bc6-4c02-a6ba-4a867d74a26a None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:45.849195 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32568e35-6bc6-4c02-a6ba-4a867d74a26a None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:45.849471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32568e35-6bc6-4c02-a6ba-4a867d74a26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:45.872150 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-32568e35-6bc6-4c02-a6ba-4a867d74a26a None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:45.873430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-32568e35-6bc6-4c02-a6ba-4a867d74a26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:45.930639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 57/112] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:32:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:32:45.936346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb76d51-29df-4764-b832-24edf3a06d88 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:45.970839 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:46.009291 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 56/113] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:46.068362 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb76d51-29df-4764-b832-24edf3a06d88 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:46.131958 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e4c26-fbc1-42a0-9714-8e021a461280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:46.132598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e4c26-fbc1-42a0-9714-8e021a461280 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:46.132871 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e4c26-fbc1-42a0-9714-8e021a461280 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:46.133146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e4c26-fbc1-42a0-9714-8e021a461280 None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:46.134809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e4c26-fbc1-42a0-9714-8e021a461280 None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:46.136266 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e4c26-fbc1-42a0-9714-8e021a461280 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:46.137913 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 58/114] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:45 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:32:46.140655 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32568e35-6bc6-4c02-a6ba-4a867d74a26a None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:46.143786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e4c26-fbc1-42a0-9714-8e021a461280 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:46.228624 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:46.308185 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32568e35-6bc6-4c02-a6ba-4a867d74a26a None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:46.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:46.324562 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e4c26-fbc1-42a0-9714-8e021a461280 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:46.350737 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe69e0-8873-4940-acc5-5533681c43ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:46.351342 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe69e0-8873-4940-acc5-5533681c43ff None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:46.351638 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe69e0-8873-4940-acc5-5533681c43ff None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:46.351909 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe69e0-8873-4940-acc5-5533681c43ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:46.363143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe69e0-8873-4940-acc5-5533681c43ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-fafe69e0-8873-4940-acc5-5533681c43ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:46.369295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:46.370221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:46.371362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:46.371362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:46.371362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:46.371362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:46.371362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:46.371362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:46.371362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:46.371362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:46.371362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:46.371362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:46.371362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:32:46.371362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:32:46.371362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 57/115] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:46.372253 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac0e7c-9859-4dc5-9c0e-19193b1b5dd1 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:46.373622 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac0e7c-9859-4dc5-9c0e-19193b1b5dd1 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:46.377374 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac0e7c-9859-4dc5-9c0e-19193b1b5dd1 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:46.378823 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 58/116] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:46.379638 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac0e7c-9859-4dc5-9c0e-19193b1b5dd1 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:46.383065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e78523-bb2d-4336-87a4-b92471515109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:46.383684 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e78523-bb2d-4336-87a4-b92471515109 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:46.383971 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e78523-bb2d-4336-87a4-b92471515109 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:46.384250 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e78523-bb2d-4336-87a4-b92471515109 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:46.384996 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e78523-bb2d-4336-87a4-b92471515109 None admin] RBAC: Adding query filter params (role.id=14b61ba15c6d439e986b2c111ae338e3, scope.project.id=eaae93f262bf474db3770d3977f5e228, user.id=124e4e6398714d77a9c227d178de887f) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:46.385309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e78523-bb2d-4336-87a4-b92471515109 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:46.386802 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e78523-bb2d-4336-87a4-b92471515109 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:46.392672 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 59/117] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:32:46 2022] GET /identity/v3/role_assignments?user.id=124e4e6398714d77a9c227d178de887f&scope.project.id=eaae93f262bf474db3770d3977f5e228&role.id=14b61ba15c6d439e986b2c111ae338e3 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:32:46.393472 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e78523-bb2d-4336-87a4-b92471515109 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:46.553064 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac0e7c-9859-4dc5-9c0e-19193b1b5dd1 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:46.561657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e78523-bb2d-4336-87a4-b92471515109 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:46.567607 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:46.595013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c915e02-f005-485d-aa9a-10a06796f463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:46.595691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c915e02-f005-485d-aa9a-10a06796f463 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:46.596126 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c915e02-f005-485d-aa9a-10a06796f463 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:46.596570 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c915e02-f005-485d-aa9a-10a06796f463 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:46.608692 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dda357-831d-46f0-891a-6f32d45763e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:46.610102 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dda357-831d-46f0-891a-6f32d45763e5 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:46.610227 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c915e02-f005-485d-aa9a-10a06796f463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:46.610648 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dda357-831d-46f0-891a-6f32d45763e5 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:46.611097 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dda357-831d-46f0-891a-6f32d45763e5 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:46.611774 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dda357-831d-46f0-891a-6f32d45763e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:46.612086 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dda357-831d-46f0-891a-6f32d45763e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:46.613471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dda357-831d-46f0-891a-6f32d45763e5 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-7c915e02-f005-485d-aa9a-10a06796f463 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:46.617368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:46.618302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:46.619102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:46.619102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:46.619102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:46.619102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:46.619102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:46.619102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:46.619102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:46.619102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:46.619102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:46.619102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:46.619102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:32:46.619102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:32:46.619102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 59/118] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:32:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:46.620341 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe9a42-8cf6-4807-90eb-99b9d5b74891 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:46.620451 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe9a42-8cf6-4807-90eb-99b9d5b74891 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:46.620733 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe9a42-8cf6-4807-90eb-99b9d5b74891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:46.627304 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 60/119] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:32:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:46.628416 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dda357-831d-46f0-891a-6f32d45763e5 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:46.640140 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-36fe9a42-8cf6-4807-90eb-99b9d5b74891 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:46.641327 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-36fe9a42-8cf6-4807-90eb-99b9d5b74891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:46.656507 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:46.718265 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 60/120] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:46.724572 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe9a42-8cf6-4807-90eb-99b9d5b74891 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:46.775209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dda357-831d-46f0-891a-6f32d45763e5 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:46.850774 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970fe96-363d-4ee2-be41-5ea238123d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:46.851324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970fe96-363d-4ee2-be41-5ea238123d57 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:46.851606 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970fe96-363d-4ee2-be41-5ea238123d57 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:46.851880 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970fe96-363d-4ee2-be41-5ea238123d57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:46.870905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970fe96-363d-4ee2-be41-5ea238123d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-e970fe96-363d-4ee2-be41-5ea238123d57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:46.876228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:46.877100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:46.877874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:46.877874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:46.877874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:46.877874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:46.877874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:46.877874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:46.877874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:46.877874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:46.877874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:46.877874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:46.877874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:32:46.877874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:32:46.882005 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 61/121] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:46.882847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970fe96-363d-4ee2-be41-5ea238123d57 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:46.900805 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:46.912286 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe9a42-8cf6-4807-90eb-99b9d5b74891 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:46.987986 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:46.992482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970fe96-363d-4ee2-be41-5ea238123d57 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:47.007878 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d1ab1-1285-4c9e-9a66-8775e7aa09c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:47.008292 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d1ab1-1285-4c9e-9a66-8775e7aa09c8 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:47.008579 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d1ab1-1285-4c9e-9a66-8775e7aa09c8 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:47.008853 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d1ab1-1285-4c9e-9a66-8775e7aa09c8 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:47.009516 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d1ab1-1285-4c9e-9a66-8775e7aa09c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:47.009810 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d1ab1-1285-4c9e-9a66-8775e7aa09c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:47.011209 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d1ab1-1285-4c9e-9a66-8775e7aa09c8 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:47.030111 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe23daa-f27b-4f00-bb96-163a3ed35930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:47.031037 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23daa-f27b-4f00-bb96-163a3ed35930 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:47.031648 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23daa-f27b-4f00-bb96-163a3ed35930 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:47.032108 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23daa-f27b-4f00-bb96-163a3ed35930 None admin] PATH_INFO: `/v3/users/0b29cea55e144cb6a1feea5fe876a199` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:47.033279 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 61/122] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:47.033673 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe23daa-f27b-4f00-bb96-163a3ed35930 None admin] RBAC: Authorizing `identity:get_user(user_id=0b29cea55e144cb6a1feea5fe876a199)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:47.034188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d1ab1-1285-4c9e-9a66-8775e7aa09c8 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:47.035640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe23daa-f27b-4f00-bb96-163a3ed35930 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:47.038514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 62/123] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:46 2022] GET /identity/v3/users/0b29cea55e144cb6a1feea5fe876a199 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:47.039514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe23daa-f27b-4f00-bb96-163a3ed35930 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:47.159454 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d1ab1-1285-4c9e-9a66-8775e7aa09c8 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:47.192354 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe23daa-f27b-4f00-bb96-163a3ed35930 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:47.196376 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062aaec-f45f-4610-8928-5f781762f64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:47.197003 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062aaec-f45f-4610-8928-5f781762f64a None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:47.197286 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062aaec-f45f-4610-8928-5f781762f64a None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:47.197620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062aaec-f45f-4610-8928-5f781762f64a None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:47.198328 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062aaec-f45f-4610-8928-5f781762f64a None admin] RBAC: Adding query filter params (name=member) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:47.198636 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062aaec-f45f-4610-8928-5f781762f64a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:47.200001 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062aaec-f45f-4610-8928-5f781762f64a None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:47.209551 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 62/124] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:32:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:47.210460 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062aaec-f45f-4610-8928-5f781762f64a None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:47.229875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbeaad-cc7d-43e1-8033-573a9aaa92ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:47.230593 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbeaad-cc7d-43e1-8033-573a9aaa92ca None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:47.230884 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbeaad-cc7d-43e1-8033-573a9aaa92ca None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:47.231163 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbeaad-cc7d-43e1-8033-573a9aaa92ca None admin] PATH_INFO: `/v3/users/38722554f5ac49c2a9cfb6efcc8e8b54` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:47.232299 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbeaad-cc7d-43e1-8033-573a9aaa92ca None admin] RBAC: Authorizing `identity:get_user(user_id=38722554f5ac49c2a9cfb6efcc8e8b54)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:47.233812 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbeaad-cc7d-43e1-8033-573a9aaa92ca None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:47.235982 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 63/125] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:47 2022] GET /identity/v3/users/38722554f5ac49c2a9cfb6efcc8e8b54 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:47.236589 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbeaad-cc7d-43e1-8033-573a9aaa92ca None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:47.239264 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:47.265440 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:47.323058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062aaec-f45f-4610-8928-5f781762f64a None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:47.348617 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbeaad-cc7d-43e1-8033-573a9aaa92ca None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:47.360151 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b17c0-e107-400c-8919-2be692fc49d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:47.361028 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b17c0-e107-400c-8919-2be692fc49d5 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:47.361171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b17c0-e107-400c-8919-2be692fc49d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:47.361451 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b17c0-e107-400c-8919-2be692fc49d5 None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:47.362778 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b17c0-e107-400c-8919-2be692fc49d5 None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:47.364295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b17c0-e107-400c-8919-2be692fc49d5 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:47.366632 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 63/126] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:47 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:47.367425 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b17c0-e107-400c-8919-2be692fc49d5 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:47.386464 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d335fb-a7f9-401c-897c-f3c676879433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:47.387332 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d335fb-a7f9-401c-897c-f3c676879433 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:47.387818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d335fb-a7f9-401c-897c-f3c676879433 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:47.388234 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d335fb-a7f9-401c-897c-f3c676879433 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:47.399816 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d335fb-a7f9-401c-897c-f3c676879433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-b6d335fb-a7f9-401c-897c-f3c676879433 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:47.405548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:47.406722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:47.407633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:47.407633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:47.407633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:47.407633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:47.407633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:47.407633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:47.407633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:47.407633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:47.407633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:47.407633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:47.407633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:32:47.407633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:32:47.409786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 64/127] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:32:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:47.410718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d335fb-a7f9-401c-897c-f3c676879433 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:47.471547 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:47.482643 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b17c0-e107-400c-8919-2be692fc49d5 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:47.496094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:47.516533 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d335fb-a7f9-401c-897c-f3c676879433 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:47.521157 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc216417-349f-48cb-bdcf-0dcc8e81b5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:47.521913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216417-349f-48cb-bdcf-0dcc8e81b5d7 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:47.522201 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216417-349f-48cb-bdcf-0dcc8e81b5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:47.522468 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216417-349f-48cb-bdcf-0dcc8e81b5d7 None admin] PATH_INFO: `/v3/users/0b29cea55e144cb6a1feea5fe876a199` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:47.523606 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc216417-349f-48cb-bdcf-0dcc8e81b5d7 None admin] RBAC: Authorizing `identity:get_user(user_id=0b29cea55e144cb6a1feea5fe876a199)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:47.525164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc216417-349f-48cb-bdcf-0dcc8e81b5d7 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:47.526803 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 64/128] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:47 2022] GET /identity/v3/users/0b29cea55e144cb6a1feea5fe876a199 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:47.527664 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc216417-349f-48cb-bdcf-0dcc8e81b5d7 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:47.553506 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbf85f-dc44-4415-9adc-96fb201ba706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:47.554690 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbf85f-dc44-4415-9adc-96fb201ba706 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:47.555173 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbf85f-dc44-4415-9adc-96fb201ba706 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:47.555659 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbf85f-dc44-4415-9adc-96fb201ba706 None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:47.557027 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbf85f-dc44-4415-9adc-96fb201ba706 None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:47.558713 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbf85f-dc44-4415-9adc-96fb201ba706 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:47.560602 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 65/129] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:47 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:47.566130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbf85f-dc44-4415-9adc-96fb201ba706 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:47.638610 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc216417-349f-48cb-bdcf-0dcc8e81b5d7 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:47.673407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbf85f-dc44-4415-9adc-96fb201ba706 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:47.675649 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d12987-8c0a-4485-92c1-727618e9a167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:47.676594 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d12987-8c0a-4485-92c1-727618e9a167 None admin] REQUEST_METHOD: `PUT` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:47.677089 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d12987-8c0a-4485-92c1-727618e9a167 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:47.677586 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d12987-8c0a-4485-92c1-727618e9a167 None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228/users/0b29cea55e144cb6a1feea5fe876a199/roles/fc58707301804afca34ac8fe194639ed` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:47.679870 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d12987-8c0a-4485-92c1-727618e9a167 None admin] RBAC: Authorizing `identity:create_grant(project_id=eaae93f262bf474db3770d3977f5e228, user_id=0b29cea55e144cb6a1feea5fe876a199, role_id=fc58707301804afca34ac8fe194639ed)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:47.681582 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d12987-8c0a-4485-92c1-727618e9a167 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:47.699500 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 65/130] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:32:47 2022] PUT /identity/v3/projects/eaae93f262bf474db3770d3977f5e228/users/0b29cea55e144cb6a1feea5fe876a199/roles/fc58707301804afca34ac8fe194639ed => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:32:47.701378 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d12987-8c0a-4485-92c1-727618e9a167 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:47.715169 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80b62e-faff-4075-aa08-6cd373565637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:47.715798 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80b62e-faff-4075-aa08-6cd373565637 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:47.716101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80b62e-faff-4075-aa08-6cd373565637 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:47.716370 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80b62e-faff-4075-aa08-6cd373565637 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:47.717050 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80b62e-faff-4075-aa08-6cd373565637 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:47.717357 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80b62e-faff-4075-aa08-6cd373565637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:47.719240 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80b62e-faff-4075-aa08-6cd373565637 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:47.731006 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 66/131] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:32:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:47.731639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80b62e-faff-4075-aa08-6cd373565637 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:47.738910 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:47.753138 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:47.861153 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d12987-8c0a-4485-92c1-727618e9a167 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:47.870266 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80b62e-faff-4075-aa08-6cd373565637 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:47.909978 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddc22e-7b65-4a50-95c7-59fe62ae1a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:47.909978 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddc22e-7b65-4a50-95c7-59fe62ae1a8b None admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:47.909978 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddc22e-7b65-4a50-95c7-59fe62ae1a8b None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:47.909978 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddc22e-7b65-4a50-95c7-59fe62ae1a8b None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228/users/38722554f5ac49c2a9cfb6efcc8e8b54/roles/323ca657fe7b4b878fd8328ef78f29f4` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:47.915863 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ddc22e-7b65-4a50-95c7-59fe62ae1a8b None admin] RBAC: Authorizing `identity:create_grant(project_id=eaae93f262bf474db3770d3977f5e228, user_id=38722554f5ac49c2a9cfb6efcc8e8b54, role_id=323ca657fe7b4b878fd8328ef78f29f4)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:47.918709 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefc00d-eb31-4f4f-a8b4-9b4de79dfe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:47.920248 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefc00d-eb31-4f4f-a8b4-9b4de79dfe6d None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:47.921016 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ddc22e-7b65-4a50-95c7-59fe62ae1a8b None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:47.921518 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefc00d-eb31-4f4f-a8b4-9b4de79dfe6d None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:47.924341 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefc00d-eb31-4f4f-a8b4-9b4de79dfe6d None admin] PATH_INFO: `/v3/projects/b5ce6afbb1ce40de9740926e6cff5b0c` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:47.926465 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefc00d-eb31-4f4f-a8b4-9b4de79dfe6d None admin] RBAC: Authorizing `identity:get_project(project_id=b5ce6afbb1ce40de9740926e6cff5b0c)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:47.929316 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefc00d-eb31-4f4f-a8b4-9b4de79dfe6d None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:47.932868 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 66/132] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:47 2022] GET /identity/v3/projects/b5ce6afbb1ce40de9740926e6cff5b0c => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:47.935114 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefc00d-eb31-4f4f-a8b4-9b4de79dfe6d None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:47.953096 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 67/133] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:32:47 2022] PUT /identity/v3/projects/eaae93f262bf474db3770d3977f5e228/users/38722554f5ac49c2a9cfb6efcc8e8b54/roles/323ca657fe7b4b878fd8328ef78f29f4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:32:47.954337 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddc22e-7b65-4a50-95c7-59fe62ae1a8b None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:48.127427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:48.142419 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:48.164475 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefc00d-eb31-4f4f-a8b4-9b4de79dfe6d None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:48.215099 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddc22e-7b65-4a50-95c7-59fe62ae1a8b None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:48.236516 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c5d43-416a-434e-9e89-ac754c2e7864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:48.237234 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c5d43-416a-434e-9e89-ac754c2e7864 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:48.237521 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c5d43-416a-434e-9e89-ac754c2e7864 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:48.237799 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c5d43-416a-434e-9e89-ac754c2e7864 None admin] PATH_INFO: `/v3/users/0b29cea55e144cb6a1feea5fe876a199` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:48.239150 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c5d43-416a-434e-9e89-ac754c2e7864 None admin] RBAC: Authorizing `identity:get_user(user_id=0b29cea55e144cb6a1feea5fe876a199)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:48.241137 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c5d43-416a-434e-9e89-ac754c2e7864 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:48.245693 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 67/134] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:47 2022] GET /identity/v3/users/0b29cea55e144cb6a1feea5fe876a199 => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:48.252026 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c5d43-416a-434e-9e89-ac754c2e7864 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:48.301134 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fbd72-ca0e-47a6-b262-99999a25fe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:48.301809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fbd72-ca0e-47a6-b262-99999a25fe34 None admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:48.302526 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fbd72-ca0e-47a6-b262-99999a25fe34 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:48.302851 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fbd72-ca0e-47a6-b262-99999a25fe34 None admin] PATH_INFO: `/v3/projects/b5ce6afbb1ce40de9740926e6cff5b0c/users/0b29cea55e144cb6a1feea5fe876a199/roles/fc58707301804afca34ac8fe194639ed` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:48.305808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fbd72-ca0e-47a6-b262-99999a25fe34 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5ce6afbb1ce40de9740926e6cff5b0c, user_id=0b29cea55e144cb6a1feea5fe876a199, role_id=fc58707301804afca34ac8fe194639ed)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:48.307362 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fbd72-ca0e-47a6-b262-99999a25fe34 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:48.328999 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 68/135] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:32:47 2022] PUT /identity/v3/projects/b5ce6afbb1ce40de9740926e6cff5b0c/users/0b29cea55e144cb6a1feea5fe876a199/roles/fc58707301804afca34ac8fe194639ed => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:32:48.405047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c5d43-416a-434e-9e89-ac754c2e7864 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:48.464687 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03962c-6fdc-4862-a498-29aa6dfac99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:48.465415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03962c-6fdc-4862-a498-29aa6dfac99b None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:48.465647 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03962c-6fdc-4862-a498-29aa6dfac99b None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:48.465953 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03962c-6fdc-4862-a498-29aa6dfac99b None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:48.467150 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03962c-6fdc-4862-a498-29aa6dfac99b None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:48.468636 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03962c-6fdc-4862-a498-29aa6dfac99b None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:48.470774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 68/136] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:48 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:48.477304 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fbd72-ca0e-47a6-b262-99999a25fe34 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:48.653501 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fbd72-ca0e-47a6-b262-99999a25fe34 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:48.702250 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:48.710598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1b22b-796c-44c9-b712-aebff1f11ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:48.711494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1b22b-796c-44c9-b712-aebff1f11ce3 None admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:48.712211 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1b22b-796c-44c9-b712-aebff1f11ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:48.712502 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1b22b-796c-44c9-b712-aebff1f11ce3 None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228/users/0b29cea55e144cb6a1feea5fe876a199/roles/04e5ea25342a4845b0df239f7f2b0705` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:48.715217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1b22b-796c-44c9-b712-aebff1f11ce3 None admin] RBAC: Authorizing `identity:create_grant(project_id=eaae93f262bf474db3770d3977f5e228, user_id=0b29cea55e144cb6a1feea5fe876a199, role_id=04e5ea25342a4845b0df239f7f2b0705)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:48.716881 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1b22b-796c-44c9-b712-aebff1f11ce3 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:48.739201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 69/137] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:32:48 2022] PUT /identity/v3/projects/eaae93f262bf474db3770d3977f5e228/users/0b29cea55e144cb6a1feea5fe876a199/roles/04e5ea25342a4845b0df239f7f2b0705 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:32:49.060883 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc5175-8cd8-48a9-958f-15d5a5cf4e2b None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:49.061170 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc5175-8cd8-48a9-958f-15d5a5cf4e2b None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:49.061450 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc5175-8cd8-48a9-958f-15d5a5cf4e2b None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:49.063131 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 69/138] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:49.072169 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babed641-09aa-4111-a7a4-d4cd062d5908 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:49.072469 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babed641-09aa-4111-a7a4-d4cd062d5908 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:49.072727 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babed641-09aa-4111-a7a4-d4cd062d5908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:49.091083 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-babed641-09aa-4111-a7a4-d4cd062d5908 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:49.092292 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-babed641-09aa-4111-a7a4-d4cd062d5908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:49.166146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 70/139] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:49.235197 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02194a72-131e-4061-b27c-54dea43d0f9d None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:49.235490 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02194a72-131e-4061-b27c-54dea43d0f9d None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:49.235759 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02194a72-131e-4061-b27c-54dea43d0f9d None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:49.237238 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 70/140] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:49.243133 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42150367-48c8-4be9-b863-e92212e57df8 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:49.243581 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42150367-48c8-4be9-b863-e92212e57df8 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:49.243780 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42150367-48c8-4be9-b863-e92212e57df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:49.263393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-42150367-48c8-4be9-b863-e92212e57df8 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:49.264587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-42150367-48c8-4be9-b863-e92212e57df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:49.355315 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 71/141] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:49.532514 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02194a72-131e-4061-b27c-54dea43d0f9d None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:49.561811 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:49.650668 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02194a72-131e-4061-b27c-54dea43d0f9d None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:49.693457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cd085-5bf0-4225-90f6-46b6ac368d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:49.694561 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cd085-5bf0-4225-90f6-46b6ac368d31 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:49.695077 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cd085-5bf0-4225-90f6-46b6ac368d31 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:49.695546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cd085-5bf0-4225-90f6-46b6ac368d31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:49.698059 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cd085-5bf0-4225-90f6-46b6ac368d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:49.699700 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cd085-5bf0-4225-90f6-46b6ac368d31 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:49.701511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 71/142] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:32:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:49.707216 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42150367-48c8-4be9-b863-e92212e57df8 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:49.764887 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cd085-5bf0-4225-90f6-46b6ac368d31 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:49.779938 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:49.868321 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42150367-48c8-4be9-b863-e92212e57df8 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:49.934337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:49.941483 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cd085-5bf0-4225-90f6-46b6ac368d31 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:49.944332 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641aaef7-5222-4b41-b4fd-c5f4de249901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:49.944955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641aaef7-5222-4b41-b4fd-c5f4de249901 None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:49.945233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641aaef7-5222-4b41-b4fd-c5f4de249901 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:49.945550 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641aaef7-5222-4b41-b4fd-c5f4de249901 None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:49.946248 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641aaef7-5222-4b41-b4fd-c5f4de249901 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:49.947691 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641aaef7-5222-4b41-b4fd-c5f4de249901 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:50.000788 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 72/143] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Oct 8 20:32:49 2022] POST /identity/v3/users => generated 283 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:32:50.029953 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46080c-5a4e-4fd2-a58a-ce21a54b5ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:50.030754 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46080c-5a4e-4fd2-a58a-ce21a54b5ee7 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:50.031039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46080c-5a4e-4fd2-a58a-ce21a54b5ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:50.031323 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46080c-5a4e-4fd2-a58a-ce21a54b5ee7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:50.058836 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46080c-5a4e-4fd2-a58a-ce21a54b5ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-2e46080c-5a4e-4fd2-a58a-ce21a54b5ee7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:50.064404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:50.065313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:50.066205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:50.066205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:50.066205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:50.066205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:50.066205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:50.066205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:50.066205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:50.066205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:50.066205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:50.066205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:50.066205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:32:50.066205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:32:50.066205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 72/144] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:32:50.074186 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641aaef7-5222-4b41-b4fd-c5f4de249901 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:50.222519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641aaef7-5222-4b41-b4fd-c5f4de249901 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:50.231460 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:50.263139 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a0ee5-57fc-4c3a-8a83-afc1308e185e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:50.263794 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a0ee5-57fc-4c3a-8a83-afc1308e185e None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:50.264039 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a0ee5-57fc-4c3a-8a83-afc1308e185e None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:50.264315 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a0ee5-57fc-4c3a-8a83-afc1308e185e None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:50.264998 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a0ee5-57fc-4c3a-8a83-afc1308e185e None admin] RBAC: Adding query filter params (name=reader) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:50.265312 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a0ee5-57fc-4c3a-8a83-afc1308e185e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:50.266749 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a0ee5-57fc-4c3a-8a83-afc1308e185e None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:50.276985 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 73/145] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:32:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:50.282543 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46080c-5a4e-4fd2-a58a-ce21a54b5ee7 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:50.415389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46080c-5a4e-4fd2-a58a-ce21a54b5ee7 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:50.454098 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195751da-eaa0-41cc-beb0-f23d87b76c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:50.455094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195751da-eaa0-41cc-beb0-f23d87b76c6e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:50.455575 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195751da-eaa0-41cc-beb0-f23d87b76c6e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:50.456047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195751da-eaa0-41cc-beb0-f23d87b76c6e None admin] PATH_INFO: `/v3/users/124e4e6398714d77a9c227d178de887f` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:50.457397 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195751da-eaa0-41cc-beb0-f23d87b76c6e None admin] RBAC: Authorizing `identity:get_user(user_id=124e4e6398714d77a9c227d178de887f)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:50.459117 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195751da-eaa0-41cc-beb0-f23d87b76c6e None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:50.461271 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 73/146] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:50 2022] GET /identity/v3/users/124e4e6398714d77a9c227d178de887f => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:50.469259 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a0ee5-57fc-4c3a-8a83-afc1308e185e None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:50.590337 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a0ee5-57fc-4c3a-8a83-afc1308e185e None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:50.629859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f22ea7-ea9a-4a87-a835-b6f15d4067eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:50.630863 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f22ea7-ea9a-4a87-a835-b6f15d4067eb None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:50.631152 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f22ea7-ea9a-4a87-a835-b6f15d4067eb None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:50.631430 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f22ea7-ea9a-4a87-a835-b6f15d4067eb None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:50.635466 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f22ea7-ea9a-4a87-a835-b6f15d4067eb None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:50.636985 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f22ea7-ea9a-4a87-a835-b6f15d4067eb None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:50.638977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 74/147] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:50 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:50.644703 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195751da-eaa0-41cc-beb0-f23d87b76c6e None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:50.684633 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:50.795446 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195751da-eaa0-41cc-beb0-f23d87b76c6e None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:50.842657 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02963791-c109-4ff4-b88d-028989a6ae10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:50.843672 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02963791-c109-4ff4-b88d-028989a6ae10 None admin] REQUEST_METHOD: `PUT` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:50.844165 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02963791-c109-4ff4-b88d-028989a6ae10 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:50.844640 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02963791-c109-4ff4-b88d-028989a6ae10 None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228/users/124e4e6398714d77a9c227d178de887f/roles/14b61ba15c6d439e986b2c111ae338e3` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:50.846838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02963791-c109-4ff4-b88d-028989a6ae10 None admin] RBAC: Authorizing `identity:create_grant(project_id=eaae93f262bf474db3770d3977f5e228, user_id=124e4e6398714d77a9c227d178de887f, role_id=14b61ba15c6d439e986b2c111ae338e3)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:50.848492 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02963791-c109-4ff4-b88d-028989a6ae10 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:50.873187 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 74/148] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:32:50 2022] PUT /identity/v3/projects/eaae93f262bf474db3770d3977f5e228/users/124e4e6398714d77a9c227d178de887f/roles/14b61ba15c6d439e986b2c111ae338e3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:32:51.527882 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ccf82-0420-4a19-b641-0a3c018f6798 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:51.528393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ccf82-0420-4a19-b641-0a3c018f6798 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:51.528467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ccf82-0420-4a19-b641-0a3c018f6798 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:51.530095 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 75/149] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:51.537080 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b416b-f636-421e-92cf-a989343e48da None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:51.537498 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b416b-f636-421e-92cf-a989343e48da None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:51.537669 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b416b-f636-421e-92cf-a989343e48da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:51.566919 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-379b416b-f636-421e-92cf-a989343e48da None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:51.568676 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-379b416b-f636-421e-92cf-a989343e48da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:51.653033 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 75/150] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:52.060733 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9b282-4705-40cc-b95f-df52fbbfd10e None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:52.061259 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9b282-4705-40cc-b95f-df52fbbfd10e None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:52.061725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9b282-4705-40cc-b95f-df52fbbfd10e None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:52.063289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 76/151] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:52.069061 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c7fe9-c5c2-43f4-b78b-6c77cd012eb8 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:52.069349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c7fe9-c5c2-43f4-b78b-6c77cd012eb8 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:52.069623 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c7fe9-c5c2-43f4-b78b-6c77cd012eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:52.099943 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-f08c7fe9-c5c2-43f4-b78b-6c77cd012eb8 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:52.101247 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-f08c7fe9-c5c2-43f4-b78b-6c77cd012eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:52.111131 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:52.121969 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9b282-4705-40cc-b95f-df52fbbfd10e None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:52.185578 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:52.232389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 76/152] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:52.234915 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54268a5e-af68-493f-88be-3bacb42151b5 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:52.235434 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54268a5e-af68-493f-88be-3bacb42151b5 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:52.235901 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54268a5e-af68-493f-88be-3bacb42151b5 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:52.237361 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 77/153] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:52.244150 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b4b32-3893-42d8-93a7-c44afdce72d4 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:52.244738 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b4b32-3893-42d8-93a7-c44afdce72d4 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:52.245208 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b4b32-3893-42d8-93a7-c44afdce72d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:52.278588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-f75b4b32-3893-42d8-93a7-c44afdce72d4 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:52.280146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-f75b4b32-3893-42d8-93a7-c44afdce72d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:52.301218 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9b282-4705-40cc-b95f-df52fbbfd10e None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:52.351880 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b1c3c-0b97-4a83-b2a1-6c887ff4ec2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:52.352753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b1c3c-0b97-4a83-b2a1-6c887ff4ec2c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:52.353325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b1c3c-0b97-4a83-b2a1-6c887ff4ec2c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:52.353791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b1c3c-0b97-4a83-b2a1-6c887ff4ec2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:52.381535 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b1c3c-0b97-4a83-b2a1-6c887ff4ec2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-d97b1c3c-0b97-4a83-b2a1-6c887ff4ec2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:52.386976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:52.387892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:52.388663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:52.388663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:52.388663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:52.388663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:52.388663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:52.388663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:52.388663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:52.388663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:52.388663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:52.388663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:52.388663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:32:52.388663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:32:52.391115 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 77/154] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:32:52.397826 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b1c3c-0b97-4a83-b2a1-6c887ff4ec2c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:52.451499 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 78/155] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:52.538110 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:52.546485 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b1c3c-0b97-4a83-b2a1-6c887ff4ec2c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:52.601132 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46605e38-3b90-4c4e-91ad-0ca8addfea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:52.602192 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46605e38-3b90-4c4e-91ad-0ca8addfea07 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:52.602676 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46605e38-3b90-4c4e-91ad-0ca8addfea07 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:52.603133 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46605e38-3b90-4c4e-91ad-0ca8addfea07 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:52.604050 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46605e38-3b90-4c4e-91ad-0ca8addfea07 None admin] RBAC: Adding query filter params (name=member) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:52.604557 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46605e38-3b90-4c4e-91ad-0ca8addfea07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:52.606277 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46605e38-3b90-4c4e-91ad-0ca8addfea07 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:52.619208 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 78/156] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:32:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:32:52.625163 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b4b32-3893-42d8-93a7-c44afdce72d4 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:52.714687 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:52.758676 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b4b32-3893-42d8-93a7-c44afdce72d4 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:52.799467 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762835e-faa0-4c96-98dd-e3a95a9370b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:52.800111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762835e-faa0-4c96-98dd-e3a95a9370b0 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:52.800391 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762835e-faa0-4c96-98dd-e3a95a9370b0 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:52.800664 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762835e-faa0-4c96-98dd-e3a95a9370b0 None admin] PATH_INFO: `/v3/users/0b29cea55e144cb6a1feea5fe876a199` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:52.806572 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762835e-faa0-4c96-98dd-e3a95a9370b0 None admin] RBAC: Authorizing `identity:get_user(user_id=0b29cea55e144cb6a1feea5fe876a199)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:52.808021 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762835e-faa0-4c96-98dd-e3a95a9370b0 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:52.809995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 79/157] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:52 2022] GET /identity/v3/users/0b29cea55e144cb6a1feea5fe876a199 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:52.815461 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46605e38-3b90-4c4e-91ad-0ca8addfea07 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:52.944309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46605e38-3b90-4c4e-91ad-0ca8addfea07 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:52.980364 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e68e6-afef-42e0-8169-9c62217717f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:52.981368 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e68e6-afef-42e0-8169-9c62217717f9 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:52.982066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e68e6-afef-42e0-8169-9c62217717f9 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:52.982549 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e68e6-afef-42e0-8169-9c62217717f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:53.012523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:53.070647 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e68e6-afef-42e0-8169-9c62217717f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:53.072385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e68e6-afef-42e0-8169-9c62217717f9 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:53.117069 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762835e-faa0-4c96-98dd-e3a95a9370b0 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:53.209572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 79/158] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:32:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:32:53.215474 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e68e6-afef-42e0-8169-9c62217717f9 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:53.293310 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762835e-faa0-4c96-98dd-e3a95a9370b0 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:53.316916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:53.386635 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5fac-caa8-465e-b52a-6c384f793046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:53.387290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5fac-caa8-465e-b52a-6c384f793046 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:53.387570 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5fac-caa8-465e-b52a-6c384f793046 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:53.387836 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5fac-caa8-465e-b52a-6c384f793046 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:53.388571 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e68e6-afef-42e0-8169-9c62217717f9 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:53.404464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:53.416822 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc5fac-caa8-465e-b52a-6c384f793046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-35bc5fac-caa8-465e-b52a-6c384f793046 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:53.422252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:53.423100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:53.423959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:53.423959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:53.423959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:53.423959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:53.423959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:53.423959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:53.423959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:53.423959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:53.423959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:53.423959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:53.423959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:32:53.423959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:32:53.423959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 80/159] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:32:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:53.424603 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5fac-caa8-465e-b52a-6c384f793046 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:53.454893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a5ecc-cefc-4fdb-b519-1e52348affd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:53.455672 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a5ecc-cefc-4fdb-b519-1e52348affd3 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:53.455958 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a5ecc-cefc-4fdb-b519-1e52348affd3 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:53.456238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a5ecc-cefc-4fdb-b519-1e52348affd3 None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:53.458721 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a5ecc-cefc-4fdb-b519-1e52348affd3 None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:53.460233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a5ecc-cefc-4fdb-b519-1e52348affd3 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:53.461804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 80/160] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:53 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:32:53.466675 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a5ecc-cefc-4fdb-b519-1e52348affd3 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:53.663914 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a5ecc-cefc-4fdb-b519-1e52348affd3 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:53.687867 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5fac-caa8-465e-b52a-6c384f793046 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:53.708212 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:53.720841 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e21a82-2f95-4368-afb0-24f62b27f8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:53.721385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e21a82-2f95-4368-afb0-24f62b27f8b3 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:53.721663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e21a82-2f95-4368-afb0-24f62b27f8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:53.721954 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e21a82-2f95-4368-afb0-24f62b27f8b3 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:53.722641 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e21a82-2f95-4368-afb0-24f62b27f8b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:53.722943 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e21a82-2f95-4368-afb0-24f62b27f8b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:53.724923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e21a82-2f95-4368-afb0-24f62b27f8b3 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:53.741208 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 81/161] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:53.742086 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e21a82-2f95-4368-afb0-24f62b27f8b3 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:53.783548 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9b0d6-1be1-4ac1-afa2-60c8f5149c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:53.784227 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9b0d6-1be1-4ac1-afa2-60c8f5149c8c None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:53.784479 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9b0d6-1be1-4ac1-afa2-60c8f5149c8c None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:53.784755 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9b0d6-1be1-4ac1-afa2-60c8f5149c8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:53.814055 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9b0d6-1be1-4ac1-afa2-60c8f5149c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-7ce9b0d6-1be1-4ac1-afa2-60c8f5149c8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:53.819749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:53.820682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:53.821480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:53.821480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:53.821480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:53.821480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:53.821480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:53.821480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:53.821480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:53.821480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:53.821480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:53.821480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:53.821480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:32:53.821480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:32:53.821480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 81/162] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:53.822173 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58ac40-7b56-4adc-b069-7eb3a3ef97af None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:53.822725 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58ac40-7b56-4adc-b069-7eb3a3ef97af None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:53.822725 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58ac40-7b56-4adc-b069-7eb3a3ef97af None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:53.825918 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 82/163] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:53.825918 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58ac40-7b56-4adc-b069-7eb3a3ef97af None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:53.966843 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:53.974285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e21a82-2f95-4368-afb0-24f62b27f8b3 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:54.042009 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ec9e0-7b45-4462-bbbe-9fb657772033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:54.043020 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ec9e0-7b45-4462-bbbe-9fb657772033 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:54.043804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ec9e0-7b45-4462-bbbe-9fb657772033 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:54.044099 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ec9e0-7b45-4462-bbbe-9fb657772033 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:54.045082 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ec9e0-7b45-4462-bbbe-9fb657772033 None admin] RBAC: Adding query filter params (role.id=fc58707301804afca34ac8fe194639ed, scope.project.id=eaae93f262bf474db3770d3977f5e228, user.id=0b29cea55e144cb6a1feea5fe876a199) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:54.045828 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ec9e0-7b45-4462-bbbe-9fb657772033 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:54.047675 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ec9e0-7b45-4462-bbbe-9fb657772033 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:54.065927 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 82/164] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:32:53 2022] GET /identity/v3/role_assignments?user.id=0b29cea55e144cb6a1feea5fe876a199&scope.project.id=eaae93f262bf474db3770d3977f5e228&role.id=fc58707301804afca34ac8fe194639ed => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:54.065927 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ec9e0-7b45-4462-bbbe-9fb657772033 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:54.066151 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58ac40-7b56-4adc-b069-7eb3a3ef97af None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:54.166318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7a59b-a9eb-4545-8139-e2bd790c7053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:54.166986 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7a59b-a9eb-4545-8139-e2bd790c7053 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:54.167268 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7a59b-a9eb-4545-8139-e2bd790c7053 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:54.167547 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7a59b-a9eb-4545-8139-e2bd790c7053 None admin] PATH_INFO: `/v3/users/38722554f5ac49c2a9cfb6efcc8e8b54` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:54.168926 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7a59b-a9eb-4545-8139-e2bd790c7053 None admin] RBAC: Authorizing `identity:get_user(user_id=38722554f5ac49c2a9cfb6efcc8e8b54)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:54.170579 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7a59b-a9eb-4545-8139-e2bd790c7053 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:54.172302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 83/165] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:53 2022] GET /identity/v3/users/38722554f5ac49c2a9cfb6efcc8e8b54 => generated 247 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:54.173520 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4f139-7999-4f1d-a584-44aea27460c5 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:54.173801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4f139-7999-4f1d-a584-44aea27460c5 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:54.178458 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4f139-7999-4f1d-a584-44aea27460c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:54.185322 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:54.210143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-17c4f139-7999-4f1d-a584-44aea27460c5 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:54.211346 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-17c4f139-7999-4f1d-a584-44aea27460c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:54.320193 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ec9e0-7b45-4462-bbbe-9fb657772033 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:54.346056 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 84/166] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:54.349136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4f139-7999-4f1d-a584-44aea27460c5 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:54.397582 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373c71e-51ab-4b58-bab5-a66ea8113b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:54.398251 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373c71e-51ab-4b58-bab5-a66ea8113b6c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:54.398537 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373c71e-51ab-4b58-bab5-a66ea8113b6c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:54.398811 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373c71e-51ab-4b58-bab5-a66ea8113b6c None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:54.399492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373c71e-51ab-4b58-bab5-a66ea8113b6c None admin] RBAC: Adding query filter params (name=member) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:54.399797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373c71e-51ab-4b58-bab5-a66ea8113b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:54.401199 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373c71e-51ab-4b58-bab5-a66ea8113b6c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:54.430272 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 83/167] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:32:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:54.437277 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373c71e-51ab-4b58-bab5-a66ea8113b6c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:54.474883 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:54.551277 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4f139-7999-4f1d-a584-44aea27460c5 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:54.612962 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373c71e-51ab-4b58-bab5-a66ea8113b6c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:54.616399 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde4f94-7c03-499e-89e0-db0d95ca03d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:54.617179 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde4f94-7c03-499e-89e0-db0d95ca03d4 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:54.617469 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde4f94-7c03-499e-89e0-db0d95ca03d4 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:54.617740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde4f94-7c03-499e-89e0-db0d95ca03d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:54.643039 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:54.686599 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54ac01-5f03-4041-b9dd-27283c431733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:54.688055 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54ac01-5f03-4041-b9dd-27283c431733 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:54.688539 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54ac01-5f03-4041-b9dd-27283c431733 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:54.689108 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54ac01-5f03-4041-b9dd-27283c431733 None admin] PATH_INFO: `/v3/users/0b29cea55e144cb6a1feea5fe876a199` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:54.690601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54ac01-5f03-4041-b9dd-27283c431733 None admin] RBAC: Authorizing `identity:get_user(user_id=0b29cea55e144cb6a1feea5fe876a199)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:54.692242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54ac01-5f03-4041-b9dd-27283c431733 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:54.694218 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 84/168] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:54 2022] GET /identity/v3/users/0b29cea55e144cb6a1feea5fe876a199 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:32:54.701038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54ac01-5f03-4041-b9dd-27283c431733 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:54.738429 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde4f94-7c03-499e-89e0-db0d95ca03d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:54.740435 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde4f94-7c03-499e-89e0-db0d95ca03d4 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:54.831328 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:54.914025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 85/169] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:32:54.925289 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde4f94-7c03-499e-89e0-db0d95ca03d4 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:54.960797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54ac01-5f03-4041-b9dd-27283c431733 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:55.043531 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e07a9-d86d-41c8-9ede-cfc112b02e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:55.044499 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e07a9-d86d-41c8-9ede-cfc112b02e59 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:55.044979 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e07a9-d86d-41c8-9ede-cfc112b02e59 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:55.045443 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e07a9-d86d-41c8-9ede-cfc112b02e59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:55.128505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde4f94-7c03-499e-89e0-db0d95ca03d4 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:55.150925 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:55.179723 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e07a9-d86d-41c8-9ede-cfc112b02e59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:55.181139 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e07a9-d86d-41c8-9ede-cfc112b02e59 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:55.196754 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d26954-e707-4421-9c78-3774b1c817ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:55.197772 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d26954-e707-4421-9c78-3774b1c817ce None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:55.198276 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d26954-e707-4421-9c78-3774b1c817ce None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:55.198744 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d26954-e707-4421-9c78-3774b1c817ce None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:55.202391 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d26954-e707-4421-9c78-3774b1c817ce None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:55.204065 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d26954-e707-4421-9c78-3774b1c817ce None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:55.206030 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 86/170] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:54 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:32:55.209692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cdf03-982d-4221-a0c2-79a773ce043f None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:55.215742 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cdf03-982d-4221-a0c2-79a773ce043f None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:55.218387 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cdf03-982d-4221-a0c2-79a773ce043f None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:55.219874 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 87/171] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:55.220674 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cdf03-982d-4221-a0c2-79a773ce043f None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:55.303955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:55.354109 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 85/172] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:32:55.355342 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e07a9-d86d-41c8-9ede-cfc112b02e59 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:55.466259 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:55.475980 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e07a9-d86d-41c8-9ede-cfc112b02e59 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:55.487618 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cdf03-982d-4221-a0c2-79a773ce043f None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:55.524411 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1598c-e03e-49ba-bd65-d2e0ed91a1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:55.525733 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1598c-e03e-49ba-bd65-d2e0ed91a1f9 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:55.526050 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1598c-e03e-49ba-bd65-d2e0ed91a1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:55.526321 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1598c-e03e-49ba-bd65-d2e0ed91a1f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:55.547778 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48deb6fb-1c60-468b-b85c-34d3874d600e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:55.548400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48deb6fb-1c60-468b-b85c-34d3874d600e None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:55.548677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48deb6fb-1c60-468b-b85c-34d3874d600e None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:55.548944 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48deb6fb-1c60-468b-b85c-34d3874d600e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:55.549688 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48deb6fb-1c60-468b-b85c-34d3874d600e None admin] RBAC: Adding query filter params (role.id=323ca657fe7b4b878fd8328ef78f29f4, scope.project.id=eaae93f262bf474db3770d3977f5e228, user.id=38722554f5ac49c2a9cfb6efcc8e8b54) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:55.550021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48deb6fb-1c60-468b-b85c-34d3874d600e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:55.551495 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48deb6fb-1c60-468b-b85c-34d3874d600e None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:55.556207 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1598c-e03e-49ba-bd65-d2e0ed91a1f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-73a1598c-e03e-49ba-bd65-d2e0ed91a1f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:55.561211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:55.562199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:55.563000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:55.563000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:55.563000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:55.563000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:55.563000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:55.563000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:55.563000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:55.563000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:55.563000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:55.563000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:55.563000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:32:55.563000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:32:55.563000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 88/173] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:32:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:55.563662 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278b535-1311-4cf6-b51c-804844b1f8ca None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:55.564255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278b535-1311-4cf6-b51c-804844b1f8ca None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:55.564255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278b535-1311-4cf6-b51c-804844b1f8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:55.572646 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 86/174] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:32:55 2022] GET /identity/v3/role_assignments?user.id=38722554f5ac49c2a9cfb6efcc8e8b54&scope.project.id=eaae93f262bf474db3770d3977f5e228&role.id=323ca657fe7b4b878fd8328ef78f29f4 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:55.573494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48deb6fb-1c60-468b-b85c-34d3874d600e None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:55.602287 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-a278b535-1311-4cf6-b51c-804844b1f8ca None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:55.607056 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-a278b535-1311-4cf6-b51c-804844b1f8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:55.706816 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 89/175] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:55.707697 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278b535-1311-4cf6-b51c-804844b1f8ca None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:55.725175 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:55.819571 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278b535-1311-4cf6-b51c-804844b1f8ca None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:55.820373 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48deb6fb-1c60-468b-b85c-34d3874d600e None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:55.856170 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316faf7-1787-4cf3-b6af-8754523e78c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:55.856829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316faf7-1787-4cf3-b6af-8754523e78c5 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:55.857060 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316faf7-1787-4cf3-b6af-8754523e78c5 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:55.857329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316faf7-1787-4cf3-b6af-8754523e78c5 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:55.858033 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316faf7-1787-4cf3-b6af-8754523e78c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:55.858333 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316faf7-1787-4cf3-b6af-8754523e78c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:55.859965 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316faf7-1787-4cf3-b6af-8754523e78c5 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:55.868908 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 90/176] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:32:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:55.870326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8f78c-51fb-46d1-bd20-822a40f02936 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:55.870615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8f78c-51fb-46d1-bd20-822a40f02936 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:55.870889 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8f78c-51fb-46d1-bd20-822a40f02936 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:55.872260 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 91/177] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:55.873160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f02ac-252e-4d60-bf58-9ce379725553 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:55.873439 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f02ac-252e-4d60-bf58-9ce379725553 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:55.873705 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f02ac-252e-4d60-bf58-9ce379725553 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:55.875152 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 92/178] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:55.875853 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f02ac-252e-4d60-bf58-9ce379725553 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:55.911806 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b65ca-44f7-4163-99c8-23c8f5df2f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:55.912462 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b65ca-44f7-4163-99c8-23c8f5df2f3c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:55.912746 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b65ca-44f7-4163-99c8-23c8f5df2f3c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:55.913019 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b65ca-44f7-4163-99c8-23c8f5df2f3c None admin] PATH_INFO: `/v3/projects/b5ce6afbb1ce40de9740926e6cff5b0c` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:55.918714 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b65ca-44f7-4163-99c8-23c8f5df2f3c None admin] RBAC: Authorizing `identity:get_project(project_id=b5ce6afbb1ce40de9740926e6cff5b0c)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:55.920193 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b65ca-44f7-4163-99c8-23c8f5df2f3c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:55.922290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 87/179] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:55 2022] GET /identity/v3/projects/b5ce6afbb1ce40de9740926e6cff5b0c => generated 312 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:55.923459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e676fc-31d8-4bee-9be9-fa1abddbe44d None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:55.923746 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e676fc-31d8-4bee-9be9-fa1abddbe44d None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:55.924023 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e676fc-31d8-4bee-9be9-fa1abddbe44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:55.960401 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:55.968300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-e4e676fc-31d8-4bee-9be9-fa1abddbe44d None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:55.969490 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-e4e676fc-31d8-4bee-9be9-fa1abddbe44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:55.987387 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f02ac-252e-4d60-bf58-9ce379725553 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:55.991943 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:56.023585 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d40ee9-aa86-437e-bf32-9e2aecf814f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:56.024462 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d40ee9-aa86-437e-bf32-9e2aecf814f4 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:56.024924 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d40ee9-aa86-437e-bf32-9e2aecf814f4 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:56.025199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d40ee9-aa86-437e-bf32-9e2aecf814f4 None admin] PATH_INFO: `/v3/users/0b29cea55e144cb6a1feea5fe876a199` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:56.026434 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d40ee9-aa86-437e-bf32-9e2aecf814f4 None admin] RBAC: Authorizing `identity:get_user(user_id=0b29cea55e144cb6a1feea5fe876a199)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:56.027851 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d40ee9-aa86-437e-bf32-9e2aecf814f4 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:56.029608 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 93/180] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:55 2022] GET /identity/v3/users/0b29cea55e144cb6a1feea5fe876a199 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:56.030565 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2684fb0-d3a9-483f-a6bf-d9de1e60882d None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:56.030856 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2684fb0-d3a9-483f-a6bf-d9de1e60882d None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:56.031118 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2684fb0-d3a9-483f-a6bf-d9de1e60882d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:56.054292 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-c2684fb0-d3a9-483f-a6bf-d9de1e60882d None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:56.055320 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-c2684fb0-d3a9-483f-a6bf-d9de1e60882d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:56.072345 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 88/181] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:56.073709 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e676fc-31d8-4bee-9be9-fa1abddbe44d None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:56.133493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 94/182] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:56.134363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2684fb0-d3a9-483f-a6bf-d9de1e60882d None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:56.221232 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:56.235219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e676fc-31d8-4bee-9be9-fa1abddbe44d None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:56.249933 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2684fb0-d3a9-483f-a6bf-d9de1e60882d None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:56.283360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b984a-8300-4536-802e-6f0c61fe12ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:56.284648 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b984a-8300-4536-802e-6f0c61fe12ec None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:56.285360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b984a-8300-4536-802e-6f0c61fe12ec None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:56.285804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b984a-8300-4536-802e-6f0c61fe12ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:56.286918 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b984a-8300-4536-802e-6f0c61fe12ec None admin] RBAC: Adding query filter params (role.id=fc58707301804afca34ac8fe194639ed, scope.project.id=b5ce6afbb1ce40de9740926e6cff5b0c, user.id=0b29cea55e144cb6a1feea5fe876a199) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:56.287409 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b984a-8300-4536-802e-6f0c61fe12ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:56.289001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b984a-8300-4536-802e-6f0c61fe12ec None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:56.289122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54563f31-3eb1-429d-977f-0bd25e7b4173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:56.289807 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54563f31-3eb1-429d-977f-0bd25e7b4173 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:56.290186 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54563f31-3eb1-429d-977f-0bd25e7b4173 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:56.290526 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54563f31-3eb1-429d-977f-0bd25e7b4173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:56.296975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 89/183] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:32:56 2022] GET /identity/v3/role_assignments?user.id=0b29cea55e144cb6a1feea5fe876a199&scope.project.id=b5ce6afbb1ce40de9740926e6cff5b0c&role.id=fc58707301804afca34ac8fe194639ed => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:56.298040 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52191d26-8b5e-456f-9b0a-45c0a1e6731a None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:56.298328 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52191d26-8b5e-456f-9b0a-45c0a1e6731a None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:56.298605 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52191d26-8b5e-456f-9b0a-45c0a1e6731a None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:56.299909 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 90/184] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:32:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:32:56.303635 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52191d26-8b5e-456f-9b0a-45c0a1e6731a None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:56.322734 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:56.379673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54563f31-3eb1-429d-977f-0bd25e7b4173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:56.381930 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54563f31-3eb1-429d-977f-0bd25e7b4173 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:56.500625 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52191d26-8b5e-456f-9b0a-45c0a1e6731a None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:56.525166 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:56.545778 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0368d-7ecb-4202-b372-cedbc02a0b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:56.546451 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0368d-7ecb-4202-b372-cedbc02a0b9c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:56.546734 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0368d-7ecb-4202-b372-cedbc02a0b9c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:56.547014 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0368d-7ecb-4202-b372-cedbc02a0b9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:56.553525 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 95/185] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:32:56.555251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4d7c3-f626-4e53-a69c-2eeb67789818 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:56.555692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4d7c3-f626-4e53-a69c-2eeb67789818 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:56.555972 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4d7c3-f626-4e53-a69c-2eeb67789818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:56.564195 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0368d-7ecb-4202-b372-cedbc02a0b9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-06b0368d-7ecb-4202-b372-cedbc02a0b9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:56.569786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:56.570705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:56.571514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:56.571514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:56.571514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:56.571514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:56.571514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:56.571514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:56.571514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:56.571514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:56.571514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:56.571514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:56.571514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:32:56.571514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:32:56.571514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 91/186] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:32:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:56.572172 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0368d-7ecb-4202-b372-cedbc02a0b9c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:56.578238 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-62e4d7c3-f626-4e53-a69c-2eeb67789818 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:32:56.579530 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-62e4d7c3-f626-4e53-a69c-2eeb67789818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:32:56.650436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:56.662162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 96/187] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:32:56.663639 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4d7c3-f626-4e53-a69c-2eeb67789818 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:56.684594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0368d-7ecb-4202-b372-cedbc02a0b9c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:56.723773 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513ee1c-c36f-4147-9e69-561cfae4068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:56.724423 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513ee1c-c36f-4147-9e69-561cfae4068c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:56.724696 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513ee1c-c36f-4147-9e69-561cfae4068c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:56.724951 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513ee1c-c36f-4147-9e69-561cfae4068c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:56.735404 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513ee1c-c36f-4147-9e69-561cfae4068c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-2513ee1c-c36f-4147-9e69-561cfae4068c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:56.740888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:56.741875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:56.742707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:56.742707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:56.742707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:56.742707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:56.742707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:56.742707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:56.742707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:56.742707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:56.742707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:56.742707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:56.742707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:32:56.742707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:32:56.742707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 92/188] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:32:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:56.744607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513ee1c-c36f-4147-9e69-561cfae4068c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:56.780853 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4d7c3-f626-4e53-a69c-2eeb67789818 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:56.784255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:56.818786 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d490ca-c18f-430f-8a4f-e0a47e298b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:56.819417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d490ca-c18f-430f-8a4f-e0a47e298b70 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:56.819701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d490ca-c18f-430f-8a4f-e0a47e298b70 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:56.819971 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d490ca-c18f-430f-8a4f-e0a47e298b70 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:56.830245 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d490ca-c18f-430f-8a4f-e0a47e298b70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-a5d490ca-c18f-430f-8a4f-e0a47e298b70 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:32:56.835774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:32:56.836671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:32:56.837506 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:32:56.837506 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:32:56.837506 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:32:56.837506 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:32:56.837506 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:32:56.837506 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:32:56.837506 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:32:56.837506 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:32:56.837506 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:32:56.837506 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:32:56.837506 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:32:56.837506 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:32:56.837506 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 97/189] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:32:56.838685 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d490ca-c18f-430f-8a4f-e0a47e298b70 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:56.858160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513ee1c-c36f-4147-9e69-561cfae4068c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:56.886615 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:56.895159 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5a672-56df-4b33-9ef4-913eb8e49680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:56.896303 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5a672-56df-4b33-9ef4-913eb8e49680 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:56.896588 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5a672-56df-4b33-9ef4-913eb8e49680 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:56.896862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5a672-56df-4b33-9ef4-913eb8e49680 None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:56.899117 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5a672-56df-4b33-9ef4-913eb8e49680 None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:56.900646 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5a672-56df-4b33-9ef4-913eb8e49680 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:56.902379 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 93/190] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:56 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:56.903233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5a672-56df-4b33-9ef4-913eb8e49680 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:56.950087 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d490ca-c18f-430f-8a4f-e0a47e298b70 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:56.983643 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7d10a-7ed4-49fe-84d8-2b2b4d0ba62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:56.984362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7d10a-7ed4-49fe-84d8-2b2b4d0ba62e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:56.984889 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7d10a-7ed4-49fe-84d8-2b2b4d0ba62e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:56.985154 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7d10a-7ed4-49fe-84d8-2b2b4d0ba62e None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:56.985797 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7d10a-7ed4-49fe-84d8-2b2b4d0ba62e None admin] RBAC: Adding query filter params (name=admin) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:56.986125 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7d10a-7ed4-49fe-84d8-2b2b4d0ba62e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:56.987482 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7d10a-7ed4-49fe-84d8-2b2b4d0ba62e None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:57.001007 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 98/191] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:32:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:57.001007 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7d10a-7ed4-49fe-84d8-2b2b4d0ba62e None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:57.020367 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5a672-56df-4b33-9ef4-913eb8e49680 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:57.023444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:57.057036 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5407c4-bd00-4cae-bb3f-1fe9ce6ffec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:57.057653 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5407c4-bd00-4cae-bb3f-1fe9ce6ffec2 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:57.057966 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5407c4-bd00-4cae-bb3f-1fe9ce6ffec2 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:57.058242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5407c4-bd00-4cae-bb3f-1fe9ce6ffec2 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:57.058908 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5407c4-bd00-4cae-bb3f-1fe9ce6ffec2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:57.059215 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5407c4-bd00-4cae-bb3f-1fe9ce6ffec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:57.060598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5407c4-bd00-4cae-bb3f-1fe9ce6ffec2 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:57.069332 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 94/192] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:32:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:57.070150 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5407c4-bd00-4cae-bb3f-1fe9ce6ffec2 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:57.099785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7d10a-7ed4-49fe-84d8-2b2b4d0ba62e None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:57.127432 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:57.134005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a8af6-53ba-4565-b21e-05ba627fd7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:57.134616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a8af6-53ba-4565-b21e-05ba627fd7b3 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:57.134894 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a8af6-53ba-4565-b21e-05ba627fd7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:57.135167 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a8af6-53ba-4565-b21e-05ba627fd7b3 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:57.135822 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a8af6-53ba-4565-b21e-05ba627fd7b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:57.136124 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a8af6-53ba-4565-b21e-05ba627fd7b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:57.137479 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a8af6-53ba-4565-b21e-05ba627fd7b3 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:57.145321 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 99/193] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:32:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:57.146159 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a8af6-53ba-4565-b21e-05ba627fd7b3 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:57.172995 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5407c4-bd00-4cae-bb3f-1fe9ce6ffec2 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:57.205626 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af8dd0-9199-429e-b692-81a8132c9ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:57.206258 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af8dd0-9199-429e-b692-81a8132c9ac3 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:57.206532 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af8dd0-9199-429e-b692-81a8132c9ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:57.206799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af8dd0-9199-429e-b692-81a8132c9ac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:57.207619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af8dd0-9199-429e-b692-81a8132c9ac3 None admin] RBAC: Adding query filter params (role.id=04e5ea25342a4845b0df239f7f2b0705, scope.project.id=eaae93f262bf474db3770d3977f5e228, user.id=0b29cea55e144cb6a1feea5fe876a199) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:57.208040 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af8dd0-9199-429e-b692-81a8132c9ac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:57.209593 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af8dd0-9199-429e-b692-81a8132c9ac3 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:57.215193 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 95/194] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:32:57 2022] GET /identity/v3/role_assignments?user.id=0b29cea55e144cb6a1feea5fe876a199&scope.project.id=eaae93f262bf474db3770d3977f5e228&role.id=04e5ea25342a4845b0df239f7f2b0705 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:57.215952 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af8dd0-9199-429e-b692-81a8132c9ac3 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:57.232222 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:57.247863 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a8af6-53ba-4565-b21e-05ba627fd7b3 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:57.286890 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509589eb-df3b-495e-86da-4dbeb4225358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:57.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509589eb-df3b-495e-86da-4dbeb4225358 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:57.287985 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509589eb-df3b-495e-86da-4dbeb4225358 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:57.288264 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509589eb-df3b-495e-86da-4dbeb4225358 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:57.290125 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509589eb-df3b-495e-86da-4dbeb4225358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:57.291908 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509589eb-df3b-495e-86da-4dbeb4225358 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:57.298212 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 100/195] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:32:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:57.298212 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509589eb-df3b-495e-86da-4dbeb4225358 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:57.355531 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af8dd0-9199-429e-b692-81a8132c9ac3 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:57.385172 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:57.398272 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7711d4-64b6-48b3-ba5d-6a1f5ec80f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:57.399117 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7711d4-64b6-48b3-ba5d-6a1f5ec80f4c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:57.399398 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7711d4-64b6-48b3-ba5d-6a1f5ec80f4c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:57.399669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7711d4-64b6-48b3-ba5d-6a1f5ec80f4c None admin] PATH_INFO: `/v3/users/15574c1eeeac4e41917ec8dcb0ec7b81` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:57.414874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7711d4-64b6-48b3-ba5d-6a1f5ec80f4c None admin] RBAC: Authorizing `identity:get_user(user_id=15574c1eeeac4e41917ec8dcb0ec7b81)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:57.416356 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7711d4-64b6-48b3-ba5d-6a1f5ec80f4c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:57.422015 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 96/196] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:57 2022] GET /identity/v3/users/15574c1eeeac4e41917ec8dcb0ec7b81 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:57.422015 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7711d4-64b6-48b3-ba5d-6a1f5ec80f4c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:57.426362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509589eb-df3b-495e-86da-4dbeb4225358 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:57.466816 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5060d6-7968-41f9-a3aa-66ba2c790217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:57.467455 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5060d6-7968-41f9-a3aa-66ba2c790217 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:57.467734 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5060d6-7968-41f9-a3aa-66ba2c790217 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:57.468009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5060d6-7968-41f9-a3aa-66ba2c790217 None admin] PATH_INFO: `/v3/users/15574c1eeeac4e41917ec8dcb0ec7b81` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:57.471672 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5060d6-7968-41f9-a3aa-66ba2c790217 None admin] RBAC: Authorizing `identity:get_user(user_id=15574c1eeeac4e41917ec8dcb0ec7b81)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:57.471672 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5060d6-7968-41f9-a3aa-66ba2c790217 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:57.474327 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 101/197] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:57 2022] GET /identity/v3/users/15574c1eeeac4e41917ec8dcb0ec7b81 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:57.474327 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5060d6-7968-41f9-a3aa-66ba2c790217 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:57.499877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:57.540444 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7711d4-64b6-48b3-ba5d-6a1f5ec80f4c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:57.574580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db4ed2-6a56-4096-a5b7-829832886ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:57.575206 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db4ed2-6a56-4096-a5b7-829832886ea2 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:57.575484 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db4ed2-6a56-4096-a5b7-829832886ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:57.575762 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db4ed2-6a56-4096-a5b7-829832886ea2 None admin] PATH_INFO: `/v3/users/124e4e6398714d77a9c227d178de887f` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:57.576878 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db4ed2-6a56-4096-a5b7-829832886ea2 None admin] RBAC: Authorizing `identity:get_user(user_id=124e4e6398714d77a9c227d178de887f)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:57.578372 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db4ed2-6a56-4096-a5b7-829832886ea2 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:57.578473 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5060d6-7968-41f9-a3aa-66ba2c790217 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:57.579946 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 97/198] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:32:57 2022] GET /identity/v3/users/124e4e6398714d77a9c227d178de887f => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:57.580692 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db4ed2-6a56-4096-a5b7-829832886ea2 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:57.614736 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a76d40-6485-48c0-add3-c8baa6bfaeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:57.615451 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a76d40-6485-48c0-add3-c8baa6bfaeda None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:57.615733 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a76d40-6485-48c0-add3-c8baa6bfaeda None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:57.616008 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a76d40-6485-48c0-add3-c8baa6bfaeda None admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:57.616648 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a76d40-6485-48c0-add3-c8baa6bfaeda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:57.618100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a76d40-6485-48c0-add3-c8baa6bfaeda None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:57.629174 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:57.644403 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 102/199] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Oct 8 20:32:57 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:32:57.645214 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a76d40-6485-48c0-add3-c8baa6bfaeda None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:57.705741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db4ed2-6a56-4096-a5b7-829832886ea2 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:57.738139 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:57.746851 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9006bc-ec18-4a4d-8f7b-d73906e16e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:57.747475 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9006bc-ec18-4a4d-8f7b-d73906e16e1a None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:57.747750 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9006bc-ec18-4a4d-8f7b-d73906e16e1a None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:57.748032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9006bc-ec18-4a4d-8f7b-d73906e16e1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:57.761742 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a76d40-6485-48c0-add3-c8baa6bfaeda None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:57.798068 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44af21-d757-4691-97ed-ec56946583a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:57.798703 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44af21-d757-4691-97ed-ec56946583a1 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:57.798986 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44af21-d757-4691-97ed-ec56946583a1 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:57.799260 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44af21-d757-4691-97ed-ec56946583a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:57.825333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9006bc-ec18-4a4d-8f7b-d73906e16e1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:57.827394 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9006bc-ec18-4a4d-8f7b-d73906e16e1a None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:57.877802 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44af21-d757-4691-97ed-ec56946583a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:57.879593 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44af21-d757-4691-97ed-ec56946583a1 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:57.886066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:57.945979 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 98/200] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:32:57.948322 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9006bc-ec18-4a4d-8f7b-d73906e16e1a None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:57.971992 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:57.998231 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 103/201] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:32:57.999100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44af21-d757-4691-97ed-ec56946583a1 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:58.080887 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9006bc-ec18-4a4d-8f7b-d73906e16e1a None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:58.121645 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb8af2-c466-442b-a156-a9ec2aa656fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:58.122365 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb8af2-c466-442b-a156-a9ec2aa656fd None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:58.122888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb8af2-c466-442b-a156-a9ec2aa656fd None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:58.122998 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb8af2-c466-442b-a156-a9ec2aa656fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:58.126107 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44af21-d757-4691-97ed-ec56946583a1 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:58.143148 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:58.181573 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a4d38-6d8f-4f62-8f48-2220cd9906ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:58.183033 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a4d38-6d8f-4f62-8f48-2220cd9906ce None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:58.183752 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a4d38-6d8f-4f62-8f48-2220cd9906ce None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:58.184240 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a4d38-6d8f-4f62-8f48-2220cd9906ce None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:58.186315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a4d38-6d8f-4f62-8f48-2220cd9906ce None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:58.187784 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a4d38-6d8f-4f62-8f48-2220cd9906ce None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:58.189449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 104/202] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:57 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:58.194498 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a4d38-6d8f-4f62-8f48-2220cd9906ce None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:58.209619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb8af2-c466-442b-a156-a9ec2aa656fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:58.211944 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb8af2-c466-442b-a156-a9ec2aa656fd None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:58.248543 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:58.304510 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a4d38-6d8f-4f62-8f48-2220cd9906ce None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:58.342758 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a389bf-442a-4d80-969e-1afea6bfaec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:58.343582 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a389bf-442a-4d80-969e-1afea6bfaec3 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:58.346857 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 99/203] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:32:58.348044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb8af2-c466-442b-a156-a9ec2aa656fd None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:58.348334 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a389bf-442a-4d80-969e-1afea6bfaec3 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:58.353647 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a389bf-442a-4d80-969e-1afea6bfaec3 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:58.353647 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a389bf-442a-4d80-969e-1afea6bfaec3 None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:58.353647 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a389bf-442a-4d80-969e-1afea6bfaec3 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:58.353647 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 105/204] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:58 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:58.357115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a389bf-442a-4d80-969e-1afea6bfaec3 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:58.418417 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:58.468492 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a389bf-442a-4d80-969e-1afea6bfaec3 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:58.484265 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb8af2-c466-442b-a156-a9ec2aa656fd None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:58.491170 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:58.523096 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ecefd-1d77-4e36-a347-ebb749b8e5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:58.523824 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ecefd-1d77-4e36-a347-ebb749b8e5ce None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:58.524098 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ecefd-1d77-4e36-a347-ebb749b8e5ce None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:58.524368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ecefd-1d77-4e36-a347-ebb749b8e5ce None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:58.525573 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ecefd-1d77-4e36-a347-ebb749b8e5ce None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:58.527199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ecefd-1d77-4e36-a347-ebb749b8e5ce None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:58.530036 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 106/205] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:32:58 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:58.531037 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ecefd-1d77-4e36-a347-ebb749b8e5ce None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:58.536040 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2b68d-53ec-4cb2-8348-0083592372a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:58.537207 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2b68d-53ec-4cb2-8348-0083592372a0 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:58.537951 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2b68d-53ec-4cb2-8348-0083592372a0 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:58.538648 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2b68d-53ec-4cb2-8348-0083592372a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:58.539543 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2b68d-53ec-4cb2-8348-0083592372a0 None admin] RBAC: Adding query filter params (role.id=323ca657fe7b4b878fd8328ef78f29f4, scope.project.id=8a98056efe76460d9e79ef3963745a2f, user.id=15574c1eeeac4e41917ec8dcb0ec7b81) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:58.540005 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2b68d-53ec-4cb2-8348-0083592372a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:58.541694 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2b68d-53ec-4cb2-8348-0083592372a0 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:58.547714 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 100/206] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:32:58 2022] GET /identity/v3/role_assignments?user.id=15574c1eeeac4e41917ec8dcb0ec7b81&scope.project.id=8a98056efe76460d9e79ef3963745a2f&role.id=323ca657fe7b4b878fd8328ef78f29f4 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:58.554988 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2b68d-53ec-4cb2-8348-0083592372a0 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:32:58.647835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ecefd-1d77-4e36-a347-ebb749b8e5ce None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:58.686592 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8f2b9-304b-4e9e-98f4-24f3f0407610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:58.687121 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8f2b9-304b-4e9e-98f4-24f3f0407610 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:58.687398 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8f2b9-304b-4e9e-98f4-24f3f0407610 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:58.687670 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8f2b9-304b-4e9e-98f4-24f3f0407610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:58.688393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8f2b9-304b-4e9e-98f4-24f3f0407610 None admin] RBAC: Adding query filter params (role.id=04e5ea25342a4845b0df239f7f2b0705, scope.project.id=8a98056efe76460d9e79ef3963745a2f, user.id=15574c1eeeac4e41917ec8dcb0ec7b81) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:58.688700 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8f2b9-304b-4e9e-98f4-24f3f0407610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:58.690306 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8f2b9-304b-4e9e-98f4-24f3f0407610 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:58.697182 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 107/207] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:32:58 2022] GET /identity/v3/role_assignments?user.id=15574c1eeeac4e41917ec8dcb0ec7b81&scope.project.id=8a98056efe76460d9e79ef3963745a2f&role.id=04e5ea25342a4845b0df239f7f2b0705 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:32:58.737097 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2b68d-53ec-4cb2-8348-0083592372a0 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:32:58.756941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:32:58.786811 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2049d0e-d7ff-4991-8436-ad91b9b832d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:32:58.787680 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2049d0e-d7ff-4991-8436-ad91b9b832d3 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:32:58.787967 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2049d0e-d7ff-4991-8436-ad91b9b832d3 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:32:58.788249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2049d0e-d7ff-4991-8436-ad91b9b832d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:32:58.789013 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2049d0e-d7ff-4991-8436-ad91b9b832d3 None admin] RBAC: Adding query filter params (role.id=14b61ba15c6d439e986b2c111ae338e3, scope.project.id=eaae93f262bf474db3770d3977f5e228, user.id=124e4e6398714d77a9c227d178de887f) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:32:58.789327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2049d0e-d7ff-4991-8436-ad91b9b832d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:32:58.790862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2049d0e-d7ff-4991-8436-ad91b9b832d3 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:32:58.798303 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 101/208] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:32:58 2022] GET /identity/v3/role_assignments?user.id=124e4e6398714d77a9c227d178de887f&scope.project.id=eaae93f262bf474db3770d3977f5e228&role.id=14b61ba15c6d439e986b2c111ae338e3 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:00.301720 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df341c51-2fc1-470d-b8cd-39b32fbce181 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:00.302412 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df341c51-2fc1-470d-b8cd-39b32fbce181 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:00.302412 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df341c51-2fc1-470d-b8cd-39b32fbce181 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:00.303772 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 108/209] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:00.308786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b499d-92ed-4783-8f03-891076415c86 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:00.309177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b499d-92ed-4783-8f03-891076415c86 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:00.309389 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b499d-92ed-4783-8f03-891076415c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:00.327997 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-629b499d-92ed-4783-8f03-891076415c86 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:00.329186 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-629b499d-92ed-4783-8f03-891076415c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:00.396939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ccd97-1283-4381-a4d6-3718bfdad4d0 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:00.397140 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ccd97-1283-4381-a4d6-3718bfdad4d0 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:00.397373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ccd97-1283-4381-a4d6-3718bfdad4d0 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:00.399007 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 109/210] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:00.400309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 102/211] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:00.407710 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4f812-5a4b-4443-ad42-5b0c7c35c500 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:00.407710 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4f812-5a4b-4443-ad42-5b0c7c35c500 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:00.407710 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4f812-5a4b-4443-ad42-5b0c7c35c500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:00.429857 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-35f4f812-5a4b-4443-ad42-5b0c7c35c500 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:00.431073 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-35f4f812-5a4b-4443-ad42-5b0c7c35c500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:00.475379 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:00.499743 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 110/212] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:00.725153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b499d-92ed-4783-8f03-891076415c86 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:00.825901 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b499d-92ed-4783-8f03-891076415c86 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:00.831583 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4f812-5a4b-4443-ad42-5b0c7c35c500 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:00.834205 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:00.873092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4497c-1231-49e0-aaff-9a0dcdbce644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:00.874734 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4497c-1231-49e0-aaff-9a0dcdbce644 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:00.875181 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4497c-1231-49e0-aaff-9a0dcdbce644 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:00.875626 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4497c-1231-49e0-aaff-9a0dcdbce644 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:00.890348 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4497c-1231-49e0-aaff-9a0dcdbce644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-d8a4497c-1231-49e0-aaff-9a0dcdbce644 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:00.897572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:00.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:00.899682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:00.899682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:00.899682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:00.899682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:00.899682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:00.899682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:00.899682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:00.899682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:00.899682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:00.899682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:00.899682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:00.899682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:00.902705 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 103/213] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:00.908315 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4497c-1231-49e0-aaff-9a0dcdbce644 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:00.956222 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4f812-5a4b-4443-ad42-5b0c7c35c500 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:00.998102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0febba-f728-4f10-ab66-bcc1d644c049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:00.998978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0febba-f728-4f10-ab66-bcc1d644c049 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:00.999488 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0febba-f728-4f10-ab66-bcc1d644c049 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:00.999986 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0febba-f728-4f10-ab66-bcc1d644c049 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:01.001240 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0febba-f728-4f10-ab66-bcc1d644c049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:01.002965 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0febba-f728-4f10-ab66-bcc1d644c049 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:01.004763 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 111/214] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:01.010619 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0febba-f728-4f10-ab66-bcc1d644c049 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:01.029529 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4497c-1231-49e0-aaff-9a0dcdbce644 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:01.066637 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e06196-ae7d-4e20-89dc-5611b749ff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:01.067485 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e06196-ae7d-4e20-89dc-5611b749ff9f None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:01.067867 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e06196-ae7d-4e20-89dc-5611b749ff9f None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:01.068235 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e06196-ae7d-4e20-89dc-5611b749ff9f None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:01.069113 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e06196-ae7d-4e20-89dc-5611b749ff9f None admin] RBAC: Adding query filter params (name=member) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:01.069506 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e06196-ae7d-4e20-89dc-5611b749ff9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:01.071130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e06196-ae7d-4e20-89dc-5611b749ff9f None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:01.074847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:01.080919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 104/215] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:01.087604 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e06196-ae7d-4e20-89dc-5611b749ff9f None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:01.118575 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:01.137112 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0febba-f728-4f10-ab66-bcc1d644c049 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:01.174882 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac912850-e6a3-4451-a8da-5fc252efe797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:01.175772 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac912850-e6a3-4451-a8da-5fc252efe797 None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:01.176358 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac912850-e6a3-4451-a8da-5fc252efe797 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:01.176831 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac912850-e6a3-4451-a8da-5fc252efe797 None admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:01.177700 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac912850-e6a3-4451-a8da-5fc252efe797 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:01.179427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac912850-e6a3-4451-a8da-5fc252efe797 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:01.198367 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e06196-ae7d-4e20-89dc-5611b749ff9f None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:01.204637 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 112/216] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Oct 8 20:33:01 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:33:01.247270 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312645c5-592d-4379-8f07-05185e55f0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:01.248304 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312645c5-592d-4379-8f07-05185e55f0d7 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:01.248768 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312645c5-592d-4379-8f07-05185e55f0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:01.249218 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312645c5-592d-4379-8f07-05185e55f0d7 None admin] PATH_INFO: `/v3/users/d61a0faee2244b9b8de9ec6ce92376fa` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:01.266120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312645c5-592d-4379-8f07-05185e55f0d7 None admin] RBAC: Authorizing `identity:get_user(user_id=d61a0faee2244b9b8de9ec6ce92376fa)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:01.267895 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312645c5-592d-4379-8f07-05185e55f0d7 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:01.269821 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 105/217] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:01 2022] GET /identity/v3/users/d61a0faee2244b9b8de9ec6ce92376fa => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:01.278849 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac912850-e6a3-4451-a8da-5fc252efe797 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:01.296989 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15991a39-54d9-4cdf-a93a-850362340d14 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:01.297244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15991a39-54d9-4cdf-a93a-850362340d14 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:01.297580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15991a39-54d9-4cdf-a93a-850362340d14 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:01.299177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 106/218] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:01.304884 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827e3c2-b952-44e1-b972-4c304c17029e None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:01.305175 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827e3c2-b952-44e1-b972-4c304c17029e None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:01.305441 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827e3c2-b952-44e1-b972-4c304c17029e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:01.326722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-f827e3c2-b952-44e1-b972-4c304c17029e None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:01.327936 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-f827e3c2-b952-44e1-b972-4c304c17029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:01.403031 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac912850-e6a3-4451-a8da-5fc252efe797 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:01.405690 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:01.410036 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 107/219] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:33:01.412123 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408d265-ff13-4fc1-8029-6cedd7278ec9 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:01.412413 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408d265-ff13-4fc1-8029-6cedd7278ec9 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:01.413021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408d265-ff13-4fc1-8029-6cedd7278ec9 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:01.414273 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 108/220] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:01.424532 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336fac9-2d5b-45a5-bf65-3e2532293fe4 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:01.424940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336fac9-2d5b-45a5-bf65-3e2532293fe4 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:01.425139 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336fac9-2d5b-45a5-bf65-3e2532293fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:01.444968 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-1336fac9-2d5b-45a5-bf65-3e2532293fe4 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:01.446234 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-1336fac9-2d5b-45a5-bf65-3e2532293fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:01.452427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3b3ec-d142-44d1-92b5-ec0c0ed5fecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:01.453053 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3b3ec-d142-44d1-92b5-ec0c0ed5fecd None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:01.453331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3b3ec-d142-44d1-92b5-ec0c0ed5fecd None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:01.453605 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3b3ec-d142-44d1-92b5-ec0c0ed5fecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:01.463290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:01.537233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 109/221] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:01.538741 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3b3ec-d142-44d1-92b5-ec0c0ed5fecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:01.540210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3b3ec-d142-44d1-92b5-ec0c0ed5fecd None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:01.640639 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 113/222] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:01.646836 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336fac9-2d5b-45a5-bf65-3e2532293fe4 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:01.735522 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3b3ec-d142-44d1-92b5-ec0c0ed5fecd None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:01.738123 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:01.767968 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336fac9-2d5b-45a5-bf65-3e2532293fe4 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:01.812066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df6f05-d14f-437e-9728-4f717d3f2167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:01.812631 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df6f05-d14f-437e-9728-4f717d3f2167 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:01.812911 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df6f05-d14f-437e-9728-4f717d3f2167 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:01.813211 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df6f05-d14f-437e-9728-4f717d3f2167 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:01.818757 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df6f05-d14f-437e-9728-4f717d3f2167 None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:01.820261 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df6f05-d14f-437e-9728-4f717d3f2167 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:01.822112 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 110/223] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:01 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:01.827554 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df6f05-d14f-437e-9728-4f717d3f2167 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:01.854272 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:01.876649 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3b3ec-d142-44d1-92b5-ec0c0ed5fecd None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:01.933373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7d605-564e-4523-ab1f-1819c50bc999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:01.934049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7d605-564e-4523-ab1f-1819c50bc999 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:01.934335 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7d605-564e-4523-ab1f-1819c50bc999 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:01.934613 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7d605-564e-4523-ab1f-1819c50bc999 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:01.948958 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7d605-564e-4523-ab1f-1819c50bc999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-6fc7d605-564e-4523-ab1f-1819c50bc999 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:01.955427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:01.956330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:01.957158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:01.957158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:01.957158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:01.957158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:01.957158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:01.957158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:01.957158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:01.957158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:01.957158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:01.957158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:01.957158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:33:01.957158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:01.957825 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 114/224] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:33:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:33:01.958828 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7d605-564e-4523-ab1f-1819c50bc999 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:01.964438 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df6f05-d14f-437e-9728-4f717d3f2167 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:02.006000 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f156f07-9e76-49b2-a4b0-2cda3d7042bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:02.006719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f156f07-9e76-49b2-a4b0-2cda3d7042bb None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:02.007005 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f156f07-9e76-49b2-a4b0-2cda3d7042bb None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:02.007296 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f156f07-9e76-49b2-a4b0-2cda3d7042bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:02.008692 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f156f07-9e76-49b2-a4b0-2cda3d7042bb None admin] RBAC: Adding query filter params (role.id=fc58707301804afca34ac8fe194639ed, scope.project.id=8a98056efe76460d9e79ef3963745a2f, user.id=d61a0faee2244b9b8de9ec6ce92376fa) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:02.008692 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f156f07-9e76-49b2-a4b0-2cda3d7042bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:02.009875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f156f07-9e76-49b2-a4b0-2cda3d7042bb None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:02.016632 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 111/225] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:33:01 2022] GET /identity/v3/role_assignments?user.id=d61a0faee2244b9b8de9ec6ce92376fa&scope.project.id=8a98056efe76460d9e79ef3963745a2f&role.id=fc58707301804afca34ac8fe194639ed => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:02.021931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f156f07-9e76-49b2-a4b0-2cda3d7042bb None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:02.071290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:02.155553 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:02.173489 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7d605-564e-4523-ab1f-1819c50bc999 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:02.178848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f156f07-9e76-49b2-a4b0-2cda3d7042bb None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:02.217527 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da1370-5ebd-4e4e-8495-a1ea3df33e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:02.218337 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da1370-5ebd-4e4e-8495-a1ea3df33e0b None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:02.218724 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da1370-5ebd-4e4e-8495-a1ea3df33e0b None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:02.219103 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da1370-5ebd-4e4e-8495-a1ea3df33e0b None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:02.219880 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da1370-5ebd-4e4e-8495-a1ea3df33e0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:02.220294 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da1370-5ebd-4e4e-8495-a1ea3df33e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:02.221798 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da1370-5ebd-4e4e-8495-a1ea3df33e0b None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:02.231349 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 112/226] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:02.238809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da1370-5ebd-4e4e-8495-a1ea3df33e0b None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:02.260158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431edcd0-1a9b-45c0-a6cf-0b1648fb6bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:02.260813 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431edcd0-1a9b-45c0-a6cf-0b1648fb6bb1 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:02.261091 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431edcd0-1a9b-45c0-a6cf-0b1648fb6bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:02.261369 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431edcd0-1a9b-45c0-a6cf-0b1648fb6bb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:02.282462 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431edcd0-1a9b-45c0-a6cf-0b1648fb6bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-431edcd0-1a9b-45c0-a6cf-0b1648fb6bb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:02.288244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:02.289190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:02.289998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:02.289998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:02.289998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:02.289998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:02.289998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:02.289998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:02.289998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:02.289998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:02.289998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:02.289998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:02.289998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:02.289998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:02.292786 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 115/227] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:33:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:02.299544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431edcd0-1a9b-45c0-a6cf-0b1648fb6bb1 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:02.408937 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da1370-5ebd-4e4e-8495-a1ea3df33e0b None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:02.416941 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431edcd0-1a9b-45c0-a6cf-0b1648fb6bb1 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:02.446283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:02.458122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d526f0a-bcba-49c9-909c-94cca4fabae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:02.458757 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d526f0a-bcba-49c9-909c-94cca4fabae0 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:02.459071 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d526f0a-bcba-49c9-909c-94cca4fabae0 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:02.459310 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d526f0a-bcba-49c9-909c-94cca4fabae0 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:02.459982 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d526f0a-bcba-49c9-909c-94cca4fabae0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:02.460288 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d526f0a-bcba-49c9-909c-94cca4fabae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:02.461672 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d526f0a-bcba-49c9-909c-94cca4fabae0 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:02.475535 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 116/228] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:02.476851 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d526f0a-bcba-49c9-909c-94cca4fabae0 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:02.512697 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c74f9-f966-4380-b686-3bbbe651e6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:02.513344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c74f9-f966-4380-b686-3bbbe651e6ab None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:02.513626 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c74f9-f966-4380-b686-3bbbe651e6ab None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:02.513926 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c74f9-f966-4380-b686-3bbbe651e6ab None admin] PATH_INFO: `/v3/users/15574c1eeeac4e41917ec8dcb0ec7b81` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:02.515062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c74f9-f966-4380-b686-3bbbe651e6ab None admin] RBAC: Authorizing `identity:get_user(user_id=15574c1eeeac4e41917ec8dcb0ec7b81)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:02.516592 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c74f9-f966-4380-b686-3bbbe651e6ab None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:02.522283 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 113/229] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:02 2022] GET /identity/v3/users/15574c1eeeac4e41917ec8dcb0ec7b81 => generated 283 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:02.523991 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c74f9-f966-4380-b686-3bbbe651e6ab None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:02.558232 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:02.607714 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d526f0a-bcba-49c9-909c-94cca4fabae0 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:02.642349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00f13f-946b-4c4a-a011-4ad7b7d77720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:02.642990 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00f13f-946b-4c4a-a011-4ad7b7d77720 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:02.643277 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00f13f-946b-4c4a-a011-4ad7b7d77720 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:02.643556 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00f13f-946b-4c4a-a011-4ad7b7d77720 None admin] PATH_INFO: `/v3/users/15574c1eeeac4e41917ec8dcb0ec7b81` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:02.644685 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00f13f-946b-4c4a-a011-4ad7b7d77720 None admin] RBAC: Authorizing `identity:get_user(user_id=15574c1eeeac4e41917ec8dcb0ec7b81)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:02.646193 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00f13f-946b-4c4a-a011-4ad7b7d77720 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:02.648113 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 117/230] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:02 2022] GET /identity/v3/users/15574c1eeeac4e41917ec8dcb0ec7b81 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:02.653463 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00f13f-946b-4c4a-a011-4ad7b7d77720 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:02.712171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:02.760321 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00f13f-946b-4c4a-a011-4ad7b7d77720 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:02.771099 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c74f9-f966-4380-b686-3bbbe651e6ab None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:02.794720 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189fc71-de92-4bac-b037-280689ea4171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:02.795448 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189fc71-de92-4bac-b037-280689ea4171 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:02.795800 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189fc71-de92-4bac-b037-280689ea4171 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:02.796143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189fc71-de92-4bac-b037-280689ea4171 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:02.797427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d189fc71-de92-4bac-b037-280689ea4171 None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:02.799259 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d189fc71-de92-4bac-b037-280689ea4171 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:02.805995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 118/231] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:02 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:02.807263 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189fc71-de92-4bac-b037-280689ea4171 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:02.858753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313806d-94ad-4272-ae17-797ff4df2459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:02.859641 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313806d-94ad-4272-ae17-797ff4df2459 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:02.859925 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313806d-94ad-4272-ae17-797ff4df2459 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:02.860201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313806d-94ad-4272-ae17-797ff4df2459 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:02.861321 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313806d-94ad-4272-ae17-797ff4df2459 None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:02.862798 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313806d-94ad-4272-ae17-797ff4df2459 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:02.865326 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 114/232] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:02 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:02.874809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313806d-94ad-4272-ae17-797ff4df2459 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:02.916816 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189fc71-de92-4bac-b037-280689ea4171 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:02.937819 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:02.954367 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01044629-f93f-4a16-bdee-f94570551241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:02.955392 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01044629-f93f-4a16-bdee-f94570551241 None admin] REQUEST_METHOD: `PUT` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:02.955877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01044629-f93f-4a16-bdee-f94570551241 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:02.956377 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01044629-f93f-4a16-bdee-f94570551241 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f/users/15574c1eeeac4e41917ec8dcb0ec7b81/roles/04e5ea25342a4845b0df239f7f2b0705` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:02.966772 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01044629-f93f-4a16-bdee-f94570551241 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a98056efe76460d9e79ef3963745a2f, user_id=15574c1eeeac4e41917ec8dcb0ec7b81, role_id=04e5ea25342a4845b0df239f7f2b0705)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:02.968522 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01044629-f93f-4a16-bdee-f94570551241 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:02.982753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:02.998133 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 119/233] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:33:02 2022] PUT /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f/users/15574c1eeeac4e41917ec8dcb0ec7b81/roles/04e5ea25342a4845b0df239f7f2b0705 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:33:03.007820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313806d-94ad-4272-ae17-797ff4df2459 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:03.045481 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d86d58-c69e-4a70-a8aa-508c8f78e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:03.046203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d86d58-c69e-4a70-a8aa-508c8f78e1fe None admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:03.046492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d86d58-c69e-4a70-a8aa-508c8f78e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:03.046773 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d86d58-c69e-4a70-a8aa-508c8f78e1fe None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f/users/15574c1eeeac4e41917ec8dcb0ec7b81/roles/323ca657fe7b4b878fd8328ef78f29f4` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:03.048792 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d86d58-c69e-4a70-a8aa-508c8f78e1fe None admin] RBAC: Authorizing `identity:create_grant(project_id=8a98056efe76460d9e79ef3963745a2f, user_id=15574c1eeeac4e41917ec8dcb0ec7b81, role_id=323ca657fe7b4b878fd8328ef78f29f4)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:03.050281 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d86d58-c69e-4a70-a8aa-508c8f78e1fe None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:03.088724 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 115/234] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:33:02 2022] PUT /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f/users/15574c1eeeac4e41917ec8dcb0ec7b81/roles/323ca657fe7b4b878fd8328ef78f29f4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:33:04.440299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4a3de-ac0f-45b3-a39a-d8431e49c2ca None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:04.441252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4a3de-ac0f-45b3-a39a-d8431e49c2ca None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:04.441740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4a3de-ac0f-45b3-a39a-d8431e49c2ca None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:04.443475 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 120/235] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:04.449271 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21c88f-43d5-44d6-99ee-8cc8147173e8 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:04.450159 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21c88f-43d5-44d6-99ee-8cc8147173e8 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:04.450659 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21c88f-43d5-44d6-99ee-8cc8147173e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:04.478993 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-9d21c88f-43d5-44d6-99ee-8cc8147173e8 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:04.480550 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-9d21c88f-43d5-44d6-99ee-8cc8147173e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:04.573465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 116/236] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:04.605083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1b4a3-03c4-45eb-908f-daf73685d946 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:04.605717 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1b4a3-03c4-45eb-908f-daf73685d946 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:04.606218 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1b4a3-03c4-45eb-908f-daf73685d946 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:04.607748 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 121/237] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:04.621225 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f102ff8-31e5-40cb-9a82-80bc55edeeb3 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:04.621804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f102ff8-31e5-40cb-9a82-80bc55edeeb3 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:04.622322 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f102ff8-31e5-40cb-9a82-80bc55edeeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:04.651125 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-7f102ff8-31e5-40cb-9a82-80bc55edeeb3 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:04.652720 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-7f102ff8-31e5-40cb-9a82-80bc55edeeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:04.742642 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:04.756969 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 117/238] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:04.974815 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e7fec-75bb-4bd0-91f5-84e169abbd3a None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:04.975515 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e7fec-75bb-4bd0-91f5-84e169abbd3a None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:04.975999 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e7fec-75bb-4bd0-91f5-84e169abbd3a None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:04.977849 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 122/239] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:04.982882 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5318bd-3090-4f64-bf4a-7a02a0fdfd14 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:04.983177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5318bd-3090-4f64-bf4a-7a02a0fdfd14 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:04.983455 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5318bd-3090-4f64-bf4a-7a02a0fdfd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:04.988199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e7fec-75bb-4bd0-91f5-84e169abbd3a None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:05.008897 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-bb5318bd-3090-4f64-bf4a-7a02a0fdfd14 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:05.011096 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-bb5318bd-3090-4f64-bf4a-7a02a0fdfd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:05.117218 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e7fec-75bb-4bd0-91f5-84e169abbd3a None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:05.144164 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 118/240] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:05.151759 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db12e52-e5be-4569-9071-e749635b05f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:05.152399 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db12e52-e5be-4569-9071-e749635b05f9 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:05.152682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db12e52-e5be-4569-9071-e749635b05f9 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:05.152961 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db12e52-e5be-4569-9071-e749635b05f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:05.163149 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db12e52-e5be-4569-9071-e749635b05f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-4db12e52-e5be-4569-9071-e749635b05f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:05.168049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:05.168964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:05.169917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:05.169917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:05.169917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:05.169917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:05.169917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:05.169917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:05.169917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:05.169917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:05.169917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:05.169917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:05.169917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:33:05.169917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:05.169917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 123/241] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:05.177306 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5318bd-3090-4f64-bf4a-7a02a0fdfd14 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:05.231400 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db12e52-e5be-4569-9071-e749635b05f9 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:05.279509 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:05.367962 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5318bd-3090-4f64-bf4a-7a02a0fdfd14 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:05.386501 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db12e52-e5be-4569-9071-e749635b05f9 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:05.426756 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:05.445959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a2ae5-d3aa-4abf-b51a-47b8285a2cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:05.447732 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f70f9-a5e8-4163-a20c-c44862f56db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:05.448614 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a2ae5-d3aa-4abf-b51a-47b8285a2cb9 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:05.449418 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f70f9-a5e8-4163-a20c-c44862f56db2 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:05.450210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a2ae5-d3aa-4abf-b51a-47b8285a2cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:05.450829 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f70f9-a5e8-4163-a20c-c44862f56db2 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:05.451202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a2ae5-d3aa-4abf-b51a-47b8285a2cb9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:05.451905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f70f9-a5e8-4163-a20c-c44862f56db2 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:05.453110 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f70f9-a5e8-4163-a20c-c44862f56db2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:05.453919 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a2ae5-d3aa-4abf-b51a-47b8285a2cb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:05.454441 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f70f9-a5e8-4163-a20c-c44862f56db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:05.456098 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a2ae5-d3aa-4abf-b51a-47b8285a2cb9 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:05.457758 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f70f9-a5e8-4163-a20c-c44862f56db2 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:05.461145 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 124/242] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:05.468004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a2ae5-d3aa-4abf-b51a-47b8285a2cb9 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:05.480595 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 119/243] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:05.481845 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f70f9-a5e8-4163-a20c-c44862f56db2 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:05.604783 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a2ae5-d3aa-4abf-b51a-47b8285a2cb9 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:05.618199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:05.625471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f70f9-a5e8-4163-a20c-c44862f56db2 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:05.648362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d64da-bea0-4914-b8ef-7271b1ff6b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:05.649388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d64da-bea0-4914-b8ef-7271b1ff6b9f None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:05.649946 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d64da-bea0-4914-b8ef-7271b1ff6b9f None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:05.650440 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d64da-bea0-4914-b8ef-7271b1ff6b9f None admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:05.651957 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d64da-bea0-4914-b8ef-7271b1ff6b9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:05.654082 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d64da-bea0-4914-b8ef-7271b1ff6b9f None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:05.662922 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a47a5b-3e98-4b80-b65b-54719b391cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:05.663558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a47a5b-3e98-4b80-b65b-54719b391cd5 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:05.663908 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a47a5b-3e98-4b80-b65b-54719b391cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:05.664301 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a47a5b-3e98-4b80-b65b-54719b391cd5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:05.677003 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a47a5b-3e98-4b80-b65b-54719b391cd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:05.681677 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 125/244] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Oct 8 20:33:05 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-96a47a5b-3e98-4b80-b65b-54719b391cd5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:05.683092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:05.684001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:05.694393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:05.694393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:05.694393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:05.694393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:05.694393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:05.694393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:05.694393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:05.694393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:05.694393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:05.694393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:05.694393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:05.694393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:05.694393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 120/245] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:05.695156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d64da-bea0-4914-b8ef-7271b1ff6b9f None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:05.695232 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a47a5b-3e98-4b80-b65b-54719b391cd5 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:05.815337 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:05.868598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d64da-bea0-4914-b8ef-7271b1ff6b9f None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:05.908262 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6647d00-e287-43cf-9dce-072e84332705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:05.908914 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6647d00-e287-43cf-9dce-072e84332705 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:05.909238 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6647d00-e287-43cf-9dce-072e84332705 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:05.909525 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6647d00-e287-43cf-9dce-072e84332705 None admin] PATH_INFO: `/v3/users/bab87eb7a47942cebe0f33745da0e23f` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:05.927903 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6647d00-e287-43cf-9dce-072e84332705 None admin] RBAC: Authorizing `identity:get_user(user_id=bab87eb7a47942cebe0f33745da0e23f)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:05.930287 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6647d00-e287-43cf-9dce-072e84332705 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:05.932312 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 126/246] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:05 2022] GET /identity/v3/users/bab87eb7a47942cebe0f33745da0e23f => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:05.938739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6647d00-e287-43cf-9dce-072e84332705 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:05.941786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a47a5b-3e98-4b80-b65b-54719b391cd5 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:05.969133 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:05.991741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a153c6-caf0-4ecd-8ccf-fd0068140501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:05.992354 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a153c6-caf0-4ecd-8ccf-fd0068140501 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:05.992637 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a153c6-caf0-4ecd-8ccf-fd0068140501 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:05.992936 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a153c6-caf0-4ecd-8ccf-fd0068140501 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:05.994166 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a153c6-caf0-4ecd-8ccf-fd0068140501 None admin] RBAC: Adding query filter params (name=member) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:05.994475 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a153c6-caf0-4ecd-8ccf-fd0068140501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:05.996594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a153c6-caf0-4ecd-8ccf-fd0068140501 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:06.008034 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 121/247] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:06.013354 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a153c6-caf0-4ecd-8ccf-fd0068140501 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:06.078627 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6647d00-e287-43cf-9dce-072e84332705 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:06.125916 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d74e70-acc8-423a-8532-4c6e90d7aaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:06.126505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d74e70-acc8-423a-8532-4c6e90d7aaff None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:06.126782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d74e70-acc8-423a-8532-4c6e90d7aaff None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:06.127050 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d74e70-acc8-423a-8532-4c6e90d7aaff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:06.146896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a153c6-caf0-4ecd-8ccf-fd0068140501 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:06.161593 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:06.195805 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f934ba2-113d-4e26-a451-a0af9a43fa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:06.196569 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f934ba2-113d-4e26-a451-a0af9a43fa22 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:06.196924 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f934ba2-113d-4e26-a451-a0af9a43fa22 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:06.197264 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f934ba2-113d-4e26-a451-a0af9a43fa22 None admin] PATH_INFO: `/v3/users/d61a0faee2244b9b8de9ec6ce92376fa` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:06.199098 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f934ba2-113d-4e26-a451-a0af9a43fa22 None admin] RBAC: Authorizing `identity:get_user(user_id=d61a0faee2244b9b8de9ec6ce92376fa)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:06.201183 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f934ba2-113d-4e26-a451-a0af9a43fa22 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:06.204507 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 122/248] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:06 2022] GET /identity/v3/users/d61a0faee2244b9b8de9ec6ce92376fa => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:06.205593 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27864ae8-9e9c-4c1b-9185-56a542d542c7 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:06.205946 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27864ae8-9e9c-4c1b-9185-56a542d542c7 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:06.206573 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27864ae8-9e9c-4c1b-9185-56a542d542c7 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:06.208752 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 123/249] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:06.209769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00533791-f63a-469a-934c-a2b76a50b535 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:06.210246 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00533791-f63a-469a-934c-a2b76a50b535 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:06.210351 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00533791-f63a-469a-934c-a2b76a50b535 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:06.211869 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 124/250] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:06.213371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00533791-f63a-469a-934c-a2b76a50b535 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:06.219134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d74e70-acc8-423a-8532-4c6e90d7aaff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:06.220600 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d74e70-acc8-423a-8532-4c6e90d7aaff None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:06.255055 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:06.339359 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00533791-f63a-469a-934c-a2b76a50b535 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:06.355099 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 127/251] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:33:06.356798 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc53bf-2ebf-4f02-b6f9-e8c12d898c59 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:06.357545 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc53bf-2ebf-4f02-b6f9-e8c12d898c59 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:06.358434 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc53bf-2ebf-4f02-b6f9-e8c12d898c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:06.376576 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcea4bc-2192-4e42-bcea-417cd620f2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:06.377125 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcea4bc-2192-4e42-bcea-417cd620f2a5 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:06.377402 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcea4bc-2192-4e42-bcea-417cd620f2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:06.377671 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcea4bc-2192-4e42-bcea-417cd620f2a5 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:06.378814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcea4bc-2192-4e42-bcea-417cd620f2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:06.380539 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-26fc53bf-2ebf-4f02-b6f9-e8c12d898c59 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:06.381299 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcea4bc-2192-4e42-bcea-417cd620f2a5 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:06.382185 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-26fc53bf-2ebf-4f02-b6f9-e8c12d898c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:06.383326 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 125/252] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:06 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:06.384458 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7362e-2604-4ec4-a4ff-3c819a53f242 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:06.384754 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7362e-2604-4ec4-a4ff-3c819a53f242 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:06.385200 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7362e-2604-4ec4-a4ff-3c819a53f242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:06.408444 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-6ba7362e-2604-4ec4-a4ff-3c819a53f242 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:06.409785 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-6ba7362e-2604-4ec4-a4ff-3c819a53f242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:06.460634 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 128/253] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:06.462218 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc53bf-2ebf-4f02-b6f9-e8c12d898c59 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:06.478938 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:06.524023 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 126/254] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:06.529431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7362e-2604-4ec4-a4ff-3c819a53f242 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:06.577354 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:06.691679 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc53bf-2ebf-4f02-b6f9-e8c12d898c59 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:06.737515 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec21fc4-09cd-42a8-824a-24b2eb6ce521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:06.738238 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec21fc4-09cd-42a8-824a-24b2eb6ce521 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:06.738515 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec21fc4-09cd-42a8-824a-24b2eb6ce521 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:06.739324 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec21fc4-09cd-42a8-824a-24b2eb6ce521 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:06.740490 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec21fc4-09cd-42a8-824a-24b2eb6ce521 None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:06.741928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec21fc4-09cd-42a8-824a-24b2eb6ce521 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:06.743848 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 129/255] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:06 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:06.750132 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec21fc4-09cd-42a8-824a-24b2eb6ce521 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:06.755844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7362e-2604-4ec4-a4ff-3c819a53f242 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:06.829244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d426d-ec54-45c0-bc8a-84e6d6c9d311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:06.829927 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d426d-ec54-45c0-bc8a-84e6d6c9d311 None admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:06.830213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d426d-ec54-45c0-bc8a-84e6d6c9d311 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:06.830486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d426d-ec54-45c0-bc8a-84e6d6c9d311 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f/users/d61a0faee2244b9b8de9ec6ce92376fa/roles/fc58707301804afca34ac8fe194639ed` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:06.835743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d426d-ec54-45c0-bc8a-84e6d6c9d311 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a98056efe76460d9e79ef3963745a2f, user_id=d61a0faee2244b9b8de9ec6ce92376fa, role_id=fc58707301804afca34ac8fe194639ed)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:06.837185 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d426d-ec54-45c0-bc8a-84e6d6c9d311 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:06.868296 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 127/256] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:33:06 2022] PUT /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f/users/d61a0faee2244b9b8de9ec6ce92376fa/roles/fc58707301804afca34ac8fe194639ed => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:33:06.912739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec21fc4-09cd-42a8-824a-24b2eb6ce521 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:06.931131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d426d-ec54-45c0-bc8a-84e6d6c9d311 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:06.936436 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:06.953585 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8f4bd-5e73-49dc-bbc7-0d865f2a116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:06.954245 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8f4bd-5e73-49dc-bbc7-0d865f2a116e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:06.954522 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8f4bd-5e73-49dc-bbc7-0d865f2a116e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:06.954790 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8f4bd-5e73-49dc-bbc7-0d865f2a116e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:06.955621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8f4bd-5e73-49dc-bbc7-0d865f2a116e None admin] RBAC: Adding query filter params (role.id=14b61ba15c6d439e986b2c111ae338e3, scope.project.id=8a98056efe76460d9e79ef3963745a2f, user.id=bab87eb7a47942cebe0f33745da0e23f) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:06.955933 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8f4bd-5e73-49dc-bbc7-0d865f2a116e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:06.957358 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8f4bd-5e73-49dc-bbc7-0d865f2a116e None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:06.964369 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 130/257] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:33:06 2022] GET /identity/v3/role_assignments?user.id=bab87eb7a47942cebe0f33745da0e23f&scope.project.id=8a98056efe76460d9e79ef3963745a2f&role.id=14b61ba15c6d439e986b2c111ae338e3 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:06.975125 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:07.056694 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8f4bd-5e73-49dc-bbc7-0d865f2a116e None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:07.058985 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d426d-ec54-45c0-bc8a-84e6d6c9d311 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:07.206810 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73ef7d-91f5-4952-84ae-6b3b8734c632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:07.207388 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73ef7d-91f5-4952-84ae-6b3b8734c632 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:07.207740 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73ef7d-91f5-4952-84ae-6b3b8734c632 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:07.208014 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73ef7d-91f5-4952-84ae-6b3b8734c632 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:07.228124 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8f4bd-5e73-49dc-bbc7-0d865f2a116e None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:07.235248 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73ef7d-91f5-4952-84ae-6b3b8734c632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-ad73ef7d-91f5-4952-84ae-6b3b8734c632 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:07.240297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:07.241180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:07.242021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:07.242021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:07.242021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:07.242021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:07.242021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:07.242021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:07.242021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:07.242021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:07.242021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:07.242021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:07.242021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:33:07.242021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:07.242021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 128/258] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:33:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:33:07.255499 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73ef7d-91f5-4952-84ae-6b3b8734c632 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:07.267266 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e774387-c16e-4e71-80d7-f03308ebf637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:07.267920 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e774387-c16e-4e71-80d7-f03308ebf637 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:07.268200 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e774387-c16e-4e71-80d7-f03308ebf637 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:07.268493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e774387-c16e-4e71-80d7-f03308ebf637 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:07.281941 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e774387-c16e-4e71-80d7-f03308ebf637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-3e774387-c16e-4e71-80d7-f03308ebf637 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:07.288840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:07.291092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:07.293235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:07.293235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:07.293235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:07.293235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:07.293235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:07.293235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:07.293235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:07.293235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:07.293235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:07.293235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:07.293235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:07.293235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:07.293235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 131/259] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:33:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:07.298797 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e774387-c16e-4e71-80d7-f03308ebf637 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:07.386388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:07.439220 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:07.452751 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73ef7d-91f5-4952-84ae-6b3b8734c632 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:07.458168 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e774387-c16e-4e71-80d7-f03308ebf637 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:07.523502 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76d843-2148-4a84-9544-fbebce955540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:07.524032 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a81387-45c1-450b-aed5-4b93aa35c640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:07.524379 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76d843-2148-4a84-9544-fbebce955540 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:07.524379 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76d843-2148-4a84-9544-fbebce955540 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:07.524731 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76d843-2148-4a84-9544-fbebce955540 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:07.525286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76d843-2148-4a84-9544-fbebce955540 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:07.525584 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76d843-2148-4a84-9544-fbebce955540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:07.528132 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76d843-2148-4a84-9544-fbebce955540 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:07.528609 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a81387-45c1-450b-aed5-4b93aa35c640 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:07.529124 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a81387-45c1-450b-aed5-4b93aa35c640 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:07.529600 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a81387-45c1-450b-aed5-4b93aa35c640 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:07.530548 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a81387-45c1-450b-aed5-4b93aa35c640 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:07.531054 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a81387-45c1-450b-aed5-4b93aa35c640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:07.532611 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a81387-45c1-450b-aed5-4b93aa35c640 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:07.548196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 132/261] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:07.548367 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 129/261] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:07.554393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76d843-2148-4a84-9544-fbebce955540 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:07.554741 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a81387-45c1-450b-aed5-4b93aa35c640 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:07.728013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a81387-45c1-450b-aed5-4b93aa35c640 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:07.736681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:07.745937 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76d843-2148-4a84-9544-fbebce955540 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:07.794386 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51260d8-ee5f-4adb-a10d-a4a07915e627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:07.795026 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51260d8-ee5f-4adb-a10d-a4a07915e627 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:07.795304 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51260d8-ee5f-4adb-a10d-a4a07915e627 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:07.795572 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51260d8-ee5f-4adb-a10d-a4a07915e627 None admin] PATH_INFO: `/v3/users/15574c1eeeac4e41917ec8dcb0ec7b81` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:07.798443 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51260d8-ee5f-4adb-a10d-a4a07915e627 None admin] RBAC: Authorizing `identity:get_user(user_id=15574c1eeeac4e41917ec8dcb0ec7b81)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:07.801071 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51260d8-ee5f-4adb-a10d-a4a07915e627 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:07.805449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 133/262] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:07 2022] GET /identity/v3/users/15574c1eeeac4e41917ec8dcb0ec7b81 => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:07.806101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e603b4a-7614-4459-87fc-b2180186e848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:07.806747 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e603b4a-7614-4459-87fc-b2180186e848 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:07.807025 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e603b4a-7614-4459-87fc-b2180186e848 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:07.807294 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e603b4a-7614-4459-87fc-b2180186e848 None admin] PATH_INFO: `/v3/users/15574c1eeeac4e41917ec8dcb0ec7b81` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:07.808434 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e603b4a-7614-4459-87fc-b2180186e848 None admin] RBAC: Authorizing `identity:get_user(user_id=15574c1eeeac4e41917ec8dcb0ec7b81)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:07.810477 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51260d8-ee5f-4adb-a10d-a4a07915e627 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:07.811506 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e603b4a-7614-4459-87fc-b2180186e848 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:07.814488 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 130/263] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:07 2022] GET /identity/v3/users/15574c1eeeac4e41917ec8dcb0ec7b81 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:07.821040 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e603b4a-7614-4459-87fc-b2180186e848 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:07.867581 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:07.997049 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e603b4a-7614-4459-87fc-b2180186e848 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:07.999824 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51260d8-ee5f-4adb-a10d-a4a07915e627 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:08.064742 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a4c9f-7e3d-4929-95eb-59e5d674d8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:08.065360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4c9f-7e3d-4929-95eb-59e5d674d8c9 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:08.065641 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4c9f-7e3d-4929-95eb-59e5d674d8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:08.066010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4c9f-7e3d-4929-95eb-59e5d674d8c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:08.069489 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a474f-2f50-456f-b57f-059d4f5e80a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:08.070139 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a474f-2f50-456f-b57f-059d4f5e80a5 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:08.070434 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a474f-2f50-456f-b57f-059d4f5e80a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:08.070694 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a474f-2f50-456f-b57f-059d4f5e80a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:08.154009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:08.198534 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a474f-2f50-456f-b57f-059d4f5e80a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:08.201825 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a474f-2f50-456f-b57f-059d4f5e80a5 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:08.226663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a4c9f-7e3d-4929-95eb-59e5d674d8c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:08.228150 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a4c9f-7e3d-4929-95eb-59e5d674d8c9 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:08.296384 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:08.315861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 134/264] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:33:08.322914 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a474f-2f50-456f-b57f-059d4f5e80a5 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:08.404048 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:08.434208 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a474f-2f50-456f-b57f-059d4f5e80a5 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:08.471570 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09c6c6-26a7-4766-8a14-89a1ae30672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:08.472443 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09c6c6-26a7-4766-8a14-89a1ae30672b None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:08.472890 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09c6c6-26a7-4766-8a14-89a1ae30672b None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:08.474194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09c6c6-26a7-4766-8a14-89a1ae30672b None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:08.475692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09c6c6-26a7-4766-8a14-89a1ae30672b None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:08.477274 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09c6c6-26a7-4766-8a14-89a1ae30672b None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:08.479895 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 135/265] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:08 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:08.486416 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09c6c6-26a7-4766-8a14-89a1ae30672b None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:08.490367 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 131/266] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:33:08.495941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a4c9f-7e3d-4929-95eb-59e5d674d8c9 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:08.594067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09c6c6-26a7-4766-8a14-89a1ae30672b None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:08.634010 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb44c58-7e01-45c0-a887-a6abd3d1bfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:08.635102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb44c58-7e01-45c0-a887-a6abd3d1bfa4 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:08.635578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb44c58-7e01-45c0-a887-a6abd3d1bfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:08.636054 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb44c58-7e01-45c0-a887-a6abd3d1bfa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:08.636961 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb44c58-7e01-45c0-a887-a6abd3d1bfa4 None admin] RBAC: Adding query filter params (role.id=323ca657fe7b4b878fd8328ef78f29f4, scope.project.id=8a98056efe76460d9e79ef3963745a2f, user.id=15574c1eeeac4e41917ec8dcb0ec7b81) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:08.637460 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb44c58-7e01-45c0-a887-a6abd3d1bfa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:08.639124 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb44c58-7e01-45c0-a887-a6abd3d1bfa4 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:08.645527 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 136/267] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:33:08 2022] GET /identity/v3/role_assignments?user.id=15574c1eeeac4e41917ec8dcb0ec7b81&scope.project.id=8a98056efe76460d9e79ef3963745a2f&role.id=323ca657fe7b4b878fd8328ef78f29f4 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:08.712461 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a4c9f-7e3d-4929-95eb-59e5d674d8c9 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:08.748791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:08.759132 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72a4b3-8053-47a4-b19c-3baaab1b73cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:08.759787 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72a4b3-8053-47a4-b19c-3baaab1b73cb None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:08.760066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72a4b3-8053-47a4-b19c-3baaab1b73cb None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:08.760337 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72a4b3-8053-47a4-b19c-3baaab1b73cb None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:08.761481 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72a4b3-8053-47a4-b19c-3baaab1b73cb None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:08.762981 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72a4b3-8053-47a4-b19c-3baaab1b73cb None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:08.764981 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 132/268] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:08 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:08.771108 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb44c58-7e01-45c0-a887-a6abd3d1bfa4 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:08.781028 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:08.890448 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb44c58-7e01-45c0-a887-a6abd3d1bfa4 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:08.940653 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b0b36-05fa-44e9-9a77-e1827fcd8d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:08.941274 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b0b36-05fa-44e9-9a77-e1827fcd8d73 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:08.941554 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b0b36-05fa-44e9-9a77-e1827fcd8d73 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:08.941861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b0b36-05fa-44e9-9a77-e1827fcd8d73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:08.942651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b0b36-05fa-44e9-9a77-e1827fcd8d73 None admin] RBAC: Adding query filter params (role.id=04e5ea25342a4845b0df239f7f2b0705, scope.project.id=8a98056efe76460d9e79ef3963745a2f, user.id=15574c1eeeac4e41917ec8dcb0ec7b81) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:08.943092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b0b36-05fa-44e9-9a77-e1827fcd8d73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:08.944552 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b0b36-05fa-44e9-9a77-e1827fcd8d73 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:08.950949 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 137/269] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:33:08 2022] GET /identity/v3/role_assignments?user.id=15574c1eeeac4e41917ec8dcb0ec7b81&scope.project.id=8a98056efe76460d9e79ef3963745a2f&role.id=04e5ea25342a4845b0df239f7f2b0705 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:09.297062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d987697-26fe-429b-8eda-14410ea117ae None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:09.297062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d987697-26fe-429b-8eda-14410ea117ae None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:09.297062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d987697-26fe-429b-8eda-14410ea117ae None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:09.297980 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 133/270] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:09.303959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd74c6a-ece7-4f4b-8e0a-81a39063d43d None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:09.304515 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd74c6a-ece7-4f4b-8e0a-81a39063d43d None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:09.304999 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd74c6a-ece7-4f4b-8e0a-81a39063d43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:09.325116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-3bd74c6a-ece7-4f4b-8e0a-81a39063d43d None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:09.326659 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-3bd74c6a-ece7-4f4b-8e0a-81a39063d43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:09.394826 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:09.395881 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2ffa4-3087-44f7-88f3-b6ed84a1f76a None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:09.396066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2ffa4-3087-44f7-88f3-b6ed84a1f76a None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:09.396311 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2ffa4-3087-44f7-88f3-b6ed84a1f76a None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:09.399290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 134/271] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:09.404608 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738a21c-603f-491c-9318-81f0205435c1 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:09.404910 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738a21c-603f-491c-9318-81f0205435c1 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:09.405161 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738a21c-603f-491c-9318-81f0205435c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:09.406203 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 138/272] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:09.425271 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-5738a21c-603f-491c-9318-81f0205435c1 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:09.426584 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-5738a21c-603f-491c-9318-81f0205435c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:09.508229 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 135/273] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:09.754028 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd74c6a-ece7-4f4b-8e0a-81a39063d43d None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:09.855074 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd74c6a-ece7-4f4b-8e0a-81a39063d43d None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:09.865125 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738a21c-603f-491c-9318-81f0205435c1 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:09.893755 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c5ede-69a4-4fb7-a7ca-b2a0274efaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:09.895348 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c5ede-69a4-4fb7-a7ca-b2a0274efaf4 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:09.895972 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c5ede-69a4-4fb7-a7ca-b2a0274efaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:09.896439 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c5ede-69a4-4fb7-a7ca-b2a0274efaf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:09.908288 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c5ede-69a4-4fb7-a7ca-b2a0274efaf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-826c5ede-69a4-4fb7-a7ca-b2a0274efaf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:09.913923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:09.914801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:09.915606 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:09.915606 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:09.915606 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:09.915606 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:09.915606 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:09.915606 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:09.915606 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:09.915606 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:09.915606 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:09.915606 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:09.915606 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:09.915606 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:09.918331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 139/274] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:33:09.928977 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c5ede-69a4-4fb7-a7ca-b2a0274efaf4 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:09.985787 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738a21c-603f-491c-9318-81f0205435c1 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:10.003001 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:10.018224 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:10.036842 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ffd5d-4a94-4683-8542-b84e6638ab1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:10.038150 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ffd5d-4a94-4683-8542-b84e6638ab1b None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:10.038632 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ffd5d-4a94-4683-8542-b84e6638ab1b None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:10.039233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ffd5d-4a94-4683-8542-b84e6638ab1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:10.041167 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ffd5d-4a94-4683-8542-b84e6638ab1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:10.043324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ffd5d-4a94-4683-8542-b84e6638ab1b None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:10.045506 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 136/275] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:10.052199 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ffd5d-4a94-4683-8542-b84e6638ab1b None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:10.052927 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c5ede-69a4-4fb7-a7ca-b2a0274efaf4 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:10.104630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df8c89-c371-4217-bdb9-e904ebebbfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:10.105626 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df8c89-c371-4217-bdb9-e904ebebbfac None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:10.106131 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df8c89-c371-4217-bdb9-e904ebebbfac None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:10.106600 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df8c89-c371-4217-bdb9-e904ebebbfac None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:10.107545 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df8c89-c371-4217-bdb9-e904ebebbfac None admin] RBAC: Adding query filter params (name=member) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:10.108732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df8c89-c371-4217-bdb9-e904ebebbfac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:10.111175 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df8c89-c371-4217-bdb9-e904ebebbfac None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:10.124171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 140/276] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:10.129585 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df8c89-c371-4217-bdb9-e904ebebbfac None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:10.173750 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ffd5d-4a94-4683-8542-b84e6638ab1b None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:10.216945 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e33c4-9f4e-4758-a993-d73a1b266500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:10.218042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e33c4-9f4e-4758-a993-d73a1b266500 None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:10.218529 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e33c4-9f4e-4758-a993-d73a1b266500 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:10.218998 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e33c4-9f4e-4758-a993-d73a1b266500 None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:10.219871 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e33c4-9f4e-4758-a993-d73a1b266500 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:10.221521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e33c4-9f4e-4758-a993-d73a1b266500 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:10.252986 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 137/277] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Oct 8 20:33:10 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:33:10.256562 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df8c89-c371-4217-bdb9-e904ebebbfac None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:10.290584 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:10.306848 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a3550-c79a-4b52-8362-015f89a87fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:10.308006 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a3550-c79a-4b52-8362-015f89a87fce None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:10.308492 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a3550-c79a-4b52-8362-015f89a87fce None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:10.309191 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a3550-c79a-4b52-8362-015f89a87fce None admin] PATH_INFO: `/v3/users/7b51a9a8b8fd4b31a2da908acc13c279` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:10.325439 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a3550-c79a-4b52-8362-015f89a87fce None admin] RBAC: Authorizing `identity:get_user(user_id=7b51a9a8b8fd4b31a2da908acc13c279)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:10.327433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a3550-c79a-4b52-8362-015f89a87fce None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:10.334092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 141/278] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:10 2022] GET /identity/v3/users/7b51a9a8b8fd4b31a2da908acc13c279 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:10.337317 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e33c4-9f4e-4758-a993-d73a1b266500 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:10.385319 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7489c15-ade3-4ccc-a420-10584e4d7926 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:10.385645 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7489c15-ade3-4ccc-a420-10584e4d7926 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:10.385898 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7489c15-ade3-4ccc-a420-10584e4d7926 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:10.387767 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 142/279] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:10.392970 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b31825-90de-43ab-b7b1-14752cd6df92 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:10.393245 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b31825-90de-43ab-b7b1-14752cd6df92 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:10.393520 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b31825-90de-43ab-b7b1-14752cd6df92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:10.400325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:10.416507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-03b31825-90de-43ab-b7b1-14752cd6df92 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:10.417924 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-03b31825-90de-43ab-b7b1-14752cd6df92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:10.466131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e33c4-9f4e-4758-a993-d73a1b266500 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:10.506951 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 143/280] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:33:10.517701 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ec89b-7132-44bd-926d-4089d0c046b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:10.518412 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ec89b-7132-44bd-926d-4089d0c046b2 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:10.518695 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ec89b-7132-44bd-926d-4089d0c046b2 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:10.518968 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ec89b-7132-44bd-926d-4089d0c046b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:10.519732 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ec89b-7132-44bd-926d-4089d0c046b2 None admin] RBAC: Adding query filter params (role.id=fc58707301804afca34ac8fe194639ed, user.id=7b51a9a8b8fd4b31a2da908acc13c279, scope.system=all) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:10.520564 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ec89b-7132-44bd-926d-4089d0c046b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:10.522451 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ec89b-7132-44bd-926d-4089d0c046b2 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:10.525358 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b15618-a52a-4602-b42d-29eb14822524 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:10.525647 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b15618-a52a-4602-b42d-29eb14822524 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:10.525962 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b15618-a52a-4602-b42d-29eb14822524 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:10.527422 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 144/281] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:33:10.527985 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 138/282] 10.222.0.36 () {56 vars in 1308 bytes} [Sat Oct 8 20:33:10 2022] GET /identity/v3/role_assignments?user.id=7b51a9a8b8fd4b31a2da908acc13c279&scope.system=all&role.id=fc58707301804afca34ac8fe194639ed => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:10.537034 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e2855-a204-4dc5-b948-d5452d9dbe49 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:10.537320 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e2855-a204-4dc5-b948-d5452d9dbe49 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:10.537715 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e2855-a204-4dc5-b948-d5452d9dbe49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:10.560469 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-b09e2855-a204-4dc5-b948-d5452d9dbe49 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:10.561615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-b09e2855-a204-4dc5-b948-d5452d9dbe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:10.646227 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 145/283] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:10.842461 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ec89b-7132-44bd-926d-4089d0c046b2 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:10.948370 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ec89b-7132-44bd-926d-4089d0c046b2 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:10.962415 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:10.984531 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473bf83-5af0-490b-96ea-25eb816b4528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:10.985168 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473bf83-5af0-490b-96ea-25eb816b4528 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:10.985449 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473bf83-5af0-490b-96ea-25eb816b4528 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:10.985720 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473bf83-5af0-490b-96ea-25eb816b4528 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:10.996666 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473bf83-5af0-490b-96ea-25eb816b4528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-a473bf83-5af0-490b-96ea-25eb816b4528 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:11.002107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:11.002992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:11.003783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:11.003783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:11.003783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:11.003783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:11.003783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:11.003783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:11.003783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:11.003783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:11.003783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:11.003783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:11.003783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:33:11.003783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:11.003783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 139/284] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:11.009421 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e2855-a204-4dc5-b948-d5452d9dbe49 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:11.058549 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:11.074601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473bf83-5af0-490b-96ea-25eb816b4528 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:11.184136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e2855-a204-4dc5-b948-d5452d9dbe49 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:11.189910 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473bf83-5af0-490b-96ea-25eb816b4528 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:11.244007 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84037ae4-20ad-4380-ae9e-c023c95a5dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:11.244655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84037ae4-20ad-4380-ae9e-c023c95a5dd4 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:11.245023 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84037ae4-20ad-4380-ae9e-c023c95a5dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:11.245310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84037ae4-20ad-4380-ae9e-c023c95a5dd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:11.256213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb86e4-56c3-4687-8dbb-a9dc8066e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:11.257126 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb86e4-56c3-4687-8dbb-a9dc8066e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:11.257601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb86e4-56c3-4687-8dbb-a9dc8066e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:11.258104 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84037ae4-20ad-4380-ae9e-c023c95a5dd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:11.258290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb86e4-56c3-4687-8dbb-a9dc8066e9c3 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:11.259158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb86e4-56c3-4687-8dbb-a9dc8066e9c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:11.259651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb86e4-56c3-4687-8dbb-a9dc8066e9c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:11.261198 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb86e4-56c3-4687-8dbb-a9dc8066e9c3 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-84037ae4-20ad-4380-ae9e-c023c95a5dd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:11.269917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:11.270832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:11.271643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:11.271643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:11.271643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:11.271643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:11.271643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:11.271643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:11.271643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:11.271643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:11.271643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:11.271643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:11.271643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:11.271643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:11.271643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 140/285] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:33:11.274020 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 146/286] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:11.278907 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84037ae4-20ad-4380-ae9e-c023c95a5dd4 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:11.292173 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb86e4-56c3-4687-8dbb-a9dc8066e9c3 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:11.342724 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:11.479286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84037ae4-20ad-4380-ae9e-c023c95a5dd4 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:11.507679 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb86e4-56c3-4687-8dbb-a9dc8066e9c3 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:11.510192 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:11.550735 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363550d7-a4f2-4069-ab3b-151795837012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:11.551436 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363550d7-a4f2-4069-ab3b-151795837012 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:11.551761 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363550d7-a4f2-4069-ab3b-151795837012 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:11.551994 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363550d7-a4f2-4069-ab3b-151795837012 None admin] PATH_INFO: `/v3/users/bab87eb7a47942cebe0f33745da0e23f` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:11.553115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363550d7-a4f2-4069-ab3b-151795837012 None admin] RBAC: Authorizing `identity:get_user(user_id=bab87eb7a47942cebe0f33745da0e23f)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:11.554629 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363550d7-a4f2-4069-ab3b-151795837012 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:11.556756 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 147/287] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:11 2022] GET /identity/v3/users/bab87eb7a47942cebe0f33745da0e23f => generated 297 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:11.562396 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363550d7-a4f2-4069-ab3b-151795837012 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:11.614587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459f1cc-9a65-430d-9b84-6b70b1137087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:11.615210 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459f1cc-9a65-430d-9b84-6b70b1137087 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:11.615491 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459f1cc-9a65-430d-9b84-6b70b1137087 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:11.615759 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459f1cc-9a65-430d-9b84-6b70b1137087 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:11.616421 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459f1cc-9a65-430d-9b84-6b70b1137087 None admin] RBAC: Adding query filter params (name=member) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:11.616721 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459f1cc-9a65-430d-9b84-6b70b1137087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:11.618111 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459f1cc-9a65-430d-9b84-6b70b1137087 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:11.643997 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 141/288] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:11.649633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459f1cc-9a65-430d-9b84-6b70b1137087 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:11.690742 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363550d7-a4f2-4069-ab3b-151795837012 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:11.765910 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471a335-597a-480f-847e-7059517dd987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:11.766482 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471a335-597a-480f-847e-7059517dd987 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:11.766760 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471a335-597a-480f-847e-7059517dd987 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:11.767029 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471a335-597a-480f-847e-7059517dd987 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:11.768311 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471a335-597a-480f-847e-7059517dd987 None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:11.774319 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471a335-597a-480f-847e-7059517dd987 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:11.775972 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 148/289] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:11 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:11.785371 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471a335-597a-480f-847e-7059517dd987 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:11.826225 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:11.838666 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459f1cc-9a65-430d-9b84-6b70b1137087 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:11.859624 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:11.877901 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9ec1e-b55f-444a-af6e-6c1ecfc6c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:11.878688 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9ec1e-b55f-444a-af6e-6c1ecfc6c08e None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:11.878972 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9ec1e-b55f-444a-af6e-6c1ecfc6c08e None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:11.879331 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9ec1e-b55f-444a-af6e-6c1ecfc6c08e None admin] PATH_INFO: `/v3/users/d61a0faee2244b9b8de9ec6ce92376fa` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:11.880901 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9ec1e-b55f-444a-af6e-6c1ecfc6c08e None admin] RBAC: Authorizing `identity:get_user(user_id=d61a0faee2244b9b8de9ec6ce92376fa)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:11.883195 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9ec1e-b55f-444a-af6e-6c1ecfc6c08e None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:11.884902 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 142/290] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:11 2022] GET /identity/v3/users/d61a0faee2244b9b8de9ec6ce92376fa => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:11.890946 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9ec1e-b55f-444a-af6e-6c1ecfc6c08e None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:11.981732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471a335-597a-480f-847e-7059517dd987 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:12.020954 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15023f-cd1d-4a9e-bc91-20ce9b353254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:12.021549 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15023f-cd1d-4a9e-bc91-20ce9b353254 None admin] REQUEST_METHOD: `PUT` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:12.021812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15023f-cd1d-4a9e-bc91-20ce9b353254 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:12.022113 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15023f-cd1d-4a9e-bc91-20ce9b353254 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f/users/bab87eb7a47942cebe0f33745da0e23f/roles/14b61ba15c6d439e986b2c111ae338e3` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:12.024043 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15023f-cd1d-4a9e-bc91-20ce9b353254 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a98056efe76460d9e79ef3963745a2f, user_id=bab87eb7a47942cebe0f33745da0e23f, role_id=14b61ba15c6d439e986b2c111ae338e3)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:12.025506 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15023f-cd1d-4a9e-bc91-20ce9b353254 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:12.045967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 149/291] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:33:11 2022] PUT /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f/users/bab87eb7a47942cebe0f33745da0e23f/roles/14b61ba15c6d439e986b2c111ae338e3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:33:12.083393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9ec1e-b55f-444a-af6e-6c1ecfc6c08e None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:12.134531 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693794b5-c62f-4803-ada6-b151c853eb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:12.135165 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693794b5-c62f-4803-ada6-b151c853eb02 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:12.135448 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693794b5-c62f-4803-ada6-b151c853eb02 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:12.135720 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693794b5-c62f-4803-ada6-b151c853eb02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:12.169017 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:12.213448 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693794b5-c62f-4803-ada6-b151c853eb02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:12.215024 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693794b5-c62f-4803-ada6-b151c853eb02 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:12.334292 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 143/292] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:33:12.343068 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15023f-cd1d-4a9e-bc91-20ce9b353254 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:12.450876 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:12.455561 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15023f-cd1d-4a9e-bc91-20ce9b353254 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:12.494253 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec35f7-334f-4710-abf7-60ee1ad2c1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:12.496411 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec35f7-334f-4710-abf7-60ee1ad2c1ec None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:12.496411 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec35f7-334f-4710-abf7-60ee1ad2c1ec None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:12.496411 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec35f7-334f-4710-abf7-60ee1ad2c1ec None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:12.497066 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec35f7-334f-4710-abf7-60ee1ad2c1ec None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:12.499338 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec35f7-334f-4710-abf7-60ee1ad2c1ec None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:12.500415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 150/293] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:12 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:12.506985 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693794b5-c62f-4803-ada6-b151c853eb02 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:12.577587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:12.624160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693794b5-c62f-4803-ada6-b151c853eb02 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:12.659710 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229a118-6655-4f85-8cb9-5a2cbfe9c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:12.660318 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229a118-6655-4f85-8cb9-5a2cbfe9c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:12.660643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229a118-6655-4f85-8cb9-5a2cbfe9c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:12.660918 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229a118-6655-4f85-8cb9-5a2cbfe9c3b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:12.661737 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229a118-6655-4f85-8cb9-5a2cbfe9c3b2 None admin] RBAC: Adding query filter params (role.id=fc58707301804afca34ac8fe194639ed, scope.project.id=8a98056efe76460d9e79ef3963745a2f, user.id=d61a0faee2244b9b8de9ec6ce92376fa) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:12.662074 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229a118-6655-4f85-8cb9-5a2cbfe9c3b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:12.663722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229a118-6655-4f85-8cb9-5a2cbfe9c3b2 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:12.670858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 144/294] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:33:12 2022] GET /identity/v3/role_assignments?user.id=d61a0faee2244b9b8de9ec6ce92376fa&scope.project.id=8a98056efe76460d9e79ef3963745a2f&role.id=fc58707301804afca34ac8fe194639ed => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:13.316022 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56e6ea-35e7-41fe-afcb-5f3b261d83d7 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:13.317554 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56e6ea-35e7-41fe-afcb-5f3b261d83d7 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:13.318080 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56e6ea-35e7-41fe-afcb-5f3b261d83d7 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:13.319900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 151/295] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:13.324869 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45070-8265-499c-be93-1d5c446a8187 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:13.325695 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45070-8265-499c-be93-1d5c446a8187 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:13.326233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45070-8265-499c-be93-1d5c446a8187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:13.347786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-5eb45070-8265-499c-be93-1d5c446a8187 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:13.349428 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-5eb45070-8265-499c-be93-1d5c446a8187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:13.405878 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeffc90-0696-4ca0-963b-bbd4be23082f None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:13.406527 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeffc90-0696-4ca0-963b-bbd4be23082f None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:13.406998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeffc90-0696-4ca0-963b-bbd4be23082f None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:13.408541 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 152/296] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:33:13.416229 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462b54d-a855-4db3-8e1e-6e886e4f9f16 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:13.416518 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462b54d-a855-4db3-8e1e-6e886e4f9f16 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:13.416792 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462b54d-a855-4db3-8e1e-6e886e4f9f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:13.434640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 145/297] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:13.437255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-5462b54d-a855-4db3-8e1e-6e886e4f9f16 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:13.442085 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-5462b54d-a855-4db3-8e1e-6e886e4f9f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:13.513817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a758f2-85df-4aaa-b4d3-aa992ab8f7cc None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:13.513817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a758f2-85df-4aaa-b4d3-aa992ab8f7cc None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:13.513817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a758f2-85df-4aaa-b4d3-aa992ab8f7cc None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:13.513817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 146/299] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:33:13.514299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 153/299] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:33:13.518995 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbd61c-6a52-4a4e-9610-0d064d12d856 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:13.519392 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbd61c-6a52-4a4e-9610-0d064d12d856 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:13.519847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbd61c-6a52-4a4e-9610-0d064d12d856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:13.538563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-f4cbd61c-6a52-4a4e-9610-0d064d12d856 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:13.539933 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-f4cbd61c-6a52-4a4e-9610-0d064d12d856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:13.593232 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:13.610339 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 147/300] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:13.765918 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462b54d-a855-4db3-8e1e-6e886e4f9f16 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:13.855616 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbd61c-6a52-4a4e-9610-0d064d12d856 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:13.869492 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:13.877363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462b54d-a855-4db3-8e1e-6e886e4f9f16 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:13.914454 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9f104-2522-419f-a796-e16c46742b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:13.915104 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9f104-2522-419f-a796-e16c46742b43 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:13.915381 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9f104-2522-419f-a796-e16c46742b43 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:13.915667 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9f104-2522-419f-a796-e16c46742b43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:13.928020 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9f104-2522-419f-a796-e16c46742b43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-56e9f104-2522-419f-a796-e16c46742b43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:13.933493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:13.934430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:13.935464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:13.935464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:13.935464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:13.935464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:13.935464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:13.935464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:13.935464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:13.935464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:13.935464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:13.935464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:13.935464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:13.935464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:13.935464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 154/301] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:13.940492 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9f104-2522-419f-a796-e16c46742b43 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:13.978813 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbd61c-6a52-4a4e-9610-0d064d12d856 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:14.013962 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83794c85-1a0f-44c8-b6b8-2f6cfd37bafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:14.014685 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83794c85-1a0f-44c8-b6b8-2f6cfd37bafd None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:14.014965 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83794c85-1a0f-44c8-b6b8-2f6cfd37bafd None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:14.015237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83794c85-1a0f-44c8-b6b8-2f6cfd37bafd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:14.025971 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83794c85-1a0f-44c8-b6b8-2f6cfd37bafd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-83794c85-1a0f-44c8-b6b8-2f6cfd37bafd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:14.030824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:14.032069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:14.032883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:14.032883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:14.032883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:14.032883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:14.032883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:14.032883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:14.032883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:14.032883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:14.032883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:14.032883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:14.032883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:33:14.032883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:14.032883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 148/302] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:33:14.033534 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83794c85-1a0f-44c8-b6b8-2f6cfd37bafd None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:14.063614 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9f104-2522-419f-a796-e16c46742b43 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:14.089868 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:14.099454 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2d4e1-5f04-4501-84e9-5cd139cb38fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:14.100064 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2d4e1-5f04-4501-84e9-5cd139cb38fd None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:14.100340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2d4e1-5f04-4501-84e9-5cd139cb38fd None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:14.100605 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2d4e1-5f04-4501-84e9-5cd139cb38fd None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:14.101260 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2d4e1-5f04-4501-84e9-5cd139cb38fd None admin] RBAC: Adding query filter params (name=member) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:14.101564 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2d4e1-5f04-4501-84e9-5cd139cb38fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:14.102957 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2d4e1-5f04-4501-84e9-5cd139cb38fd None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:14.116840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 155/303] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:14.116840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2d4e1-5f04-4501-84e9-5cd139cb38fd None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:14.136950 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:14.153832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83794c85-1a0f-44c8-b6b8-2f6cfd37bafd None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:14.189620 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d90a9-6598-4f9c-8f04-75d2bed084e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:14.190290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d90a9-6598-4f9c-8f04-75d2bed084e1 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:14.190570 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d90a9-6598-4f9c-8f04-75d2bed084e1 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:14.190842 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d90a9-6598-4f9c-8f04-75d2bed084e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:14.192584 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d90a9-6598-4f9c-8f04-75d2bed084e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:14.194179 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d90a9-6598-4f9c-8f04-75d2bed084e1 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:14.195860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 149/304] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:14.201119 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d90a9-6598-4f9c-8f04-75d2bed084e1 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:14.217593 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2d4e1-5f04-4501-84e9-5cd139cb38fd None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:14.252330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef88bb-b8f1-44c4-8711-bde7ff769990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:14.253028 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef88bb-b8f1-44c4-8711-bde7ff769990 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:14.253307 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef88bb-b8f1-44c4-8711-bde7ff769990 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:14.253579 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef88bb-b8f1-44c4-8711-bde7ff769990 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:14.254402 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef88bb-b8f1-44c4-8711-bde7ff769990 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:14.254756 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef88bb-b8f1-44c4-8711-bde7ff769990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:14.256202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef88bb-b8f1-44c4-8711-bde7ff769990 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:14.269209 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 156/305] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:14.270615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef88bb-b8f1-44c4-8711-bde7ff769990 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:14.305464 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d90a9-6598-4f9c-8f04-75d2bed084e1 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:14.320796 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:14.345696 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e44e52-0d4d-4d60-b00a-dfad07ee8bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:14.346558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e44e52-0d4d-4d60-b00a-dfad07ee8bee None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:14.346837 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e44e52-0d4d-4d60-b00a-dfad07ee8bee None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:14.347111 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e44e52-0d4d-4d60-b00a-dfad07ee8bee None admin] PATH_INFO: `/v3/users/7b51a9a8b8fd4b31a2da908acc13c279` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:14.348563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e44e52-0d4d-4d60-b00a-dfad07ee8bee None admin] RBAC: Authorizing `identity:get_user(user_id=7b51a9a8b8fd4b31a2da908acc13c279)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:14.350049 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e44e52-0d4d-4d60-b00a-dfad07ee8bee None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:14.352253 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 150/306] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:14 2022] GET /identity/v3/users/7b51a9a8b8fd4b31a2da908acc13c279 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:14.352438 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e44e52-0d4d-4d60-b00a-dfad07ee8bee None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:14.368339 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:14.389047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef88bb-b8f1-44c4-8711-bde7ff769990 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:14.424383 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d9305-4e90-4cdf-9949-3acece1d995f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:14.426293 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d9305-4e90-4cdf-9949-3acece1d995f None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:14.426571 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d9305-4e90-4cdf-9949-3acece1d995f None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:14.426844 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d9305-4e90-4cdf-9949-3acece1d995f None admin] PATH_INFO: `/v3/groups` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:14.427499 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d9305-4e90-4cdf-9949-3acece1d995f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:14.428936 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d9305-4e90-4cdf-9949-3acece1d995f None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:14.446758 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 157/307] 10.222.0.36 () {60 vars in 1134 bytes} [Sat Oct 8 20:33:14 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:33:14.447541 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d9305-4e90-4cdf-9949-3acece1d995f None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:14.466124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e44e52-0d4d-4d60-b00a-dfad07ee8bee None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:14.511321 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09918d-4fef-4517-a916-71e01d5491eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:14.512013 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09918d-4fef-4517-a916-71e01d5491eb None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:14.512292 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09918d-4fef-4517-a916-71e01d5491eb None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:14.512564 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09918d-4fef-4517-a916-71e01d5491eb None admin] PATH_INFO: `/v3/users/22ce60d801dd414aa1f3b4dd4df92a31` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:14.530971 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09918d-4fef-4517-a916-71e01d5491eb None admin] RBAC: Authorizing `identity:get_user(user_id=22ce60d801dd414aa1f3b4dd4df92a31)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:14.532655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09918d-4fef-4517-a916-71e01d5491eb None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:14.534809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 151/308] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:14 2022] GET /identity/v3/users/22ce60d801dd414aa1f3b4dd4df92a31 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:14.543947 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09918d-4fef-4517-a916-71e01d5491eb None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:14.588449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d9305-4e90-4cdf-9949-3acece1d995f None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:14.606826 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:14.630585 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240e862-9d35-4840-b11d-d20c416fac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:14.631378 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e862-9d35-4840-b11d-d20c416fac49 None admin] REQUEST_METHOD: `PUT` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:14.631592 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e862-9d35-4840-b11d-d20c416fac49 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:14.631887 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e862-9d35-4840-b11d-d20c416fac49 None admin] PATH_INFO: `/v3/system/users/7b51a9a8b8fd4b31a2da908acc13c279/roles/fc58707301804afca34ac8fe194639ed` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:14.633499 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240e862-9d35-4840-b11d-d20c416fac49 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7b51a9a8b8fd4b31a2da908acc13c279, role_id=fc58707301804afca34ac8fe194639ed)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:14.635032 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240e862-9d35-4840-b11d-d20c416fac49 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:14.649136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 158/309] 10.222.0.36 () {58 vars in 1334 bytes} [Sat Oct 8 20:33:14 2022] PUT /identity/v3/system/users/7b51a9a8b8fd4b31a2da908acc13c279/roles/fc58707301804afca34ac8fe194639ed => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:33:14.683250 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09918d-4fef-4517-a916-71e01d5491eb None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:14.727249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf68bf-3991-48ff-8c8f-2386cc70eb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:14.727884 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf68bf-3991-48ff-8c8f-2386cc70eb6f None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:14.728161 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf68bf-3991-48ff-8c8f-2386cc70eb6f None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:14.728429 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf68bf-3991-48ff-8c8f-2386cc70eb6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:14.729180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf68bf-3991-48ff-8c8f-2386cc70eb6f None admin] RBAC: Adding query filter params (role.id=14b61ba15c6d439e986b2c111ae338e3, user.id=22ce60d801dd414aa1f3b4dd4df92a31, scope.system=all) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:14.729490 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf68bf-3991-48ff-8c8f-2386cc70eb6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:14.731028 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf68bf-3991-48ff-8c8f-2386cc70eb6f None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:14.737169 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 152/310] 10.222.0.36 () {56 vars in 1308 bytes} [Sat Oct 8 20:33:14 2022] GET /identity/v3/role_assignments?user.id=22ce60d801dd414aa1f3b4dd4df92a31&scope.system=all&role.id=14b61ba15c6d439e986b2c111ae338e3 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:14.947230 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c22b3e-adf1-4538-8528-fc032cbd11a0 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:14.947526 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c22b3e-adf1-4538-8528-fc032cbd11a0 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:14.947792 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c22b3e-adf1-4538-8528-fc032cbd11a0 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:14.949141 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 159/311] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:14.955005 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daefe65-6cef-4f5f-a6c7-0fd205508994 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:14.955314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daefe65-6cef-4f5f-a6c7-0fd205508994 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:14.955560 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daefe65-6cef-4f5f-a6c7-0fd205508994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:14.975416 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-1daefe65-6cef-4f5f-a6c7-0fd205508994 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:14.976612 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-1daefe65-6cef-4f5f-a6c7-0fd205508994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:15.059252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 153/312] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:15.426695 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c22b3e-adf1-4538-8528-fc032cbd11a0 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:15.431075 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:15.545706 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c22b3e-adf1-4538-8528-fc032cbd11a0 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:15.581355 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238b8e1-71d3-43d9-ba30-02c57b528456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:15.582032 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238b8e1-71d3-43d9-ba30-02c57b528456 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:15.582883 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238b8e1-71d3-43d9-ba30-02c57b528456 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:15.583237 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238b8e1-71d3-43d9-ba30-02c57b528456 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:15.593851 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238b8e1-71d3-43d9-ba30-02c57b528456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-f238b8e1-71d3-43d9-ba30-02c57b528456 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:15.599094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:15.600111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:15.601164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:15.601164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:15.601164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:15.601164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:15.601164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:15.601164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:15.601164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:15.601164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:15.601164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:15.601164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:15.601164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:33:15.601164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:15.601164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 160/313] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:15.607224 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daefe65-6cef-4f5f-a6c7-0fd205508994 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:15.646048 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:15.725821 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daefe65-6cef-4f5f-a6c7-0fd205508994 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:15.766894 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c8452-6150-406a-a567-0ee481265da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:15.767513 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8452-6150-406a-a567-0ee481265da1 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:15.767771 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8452-6150-406a-a567-0ee481265da1 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:15.768042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8452-6150-406a-a567-0ee481265da1 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:15.768712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c8452-6150-406a-a567-0ee481265da1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:15.769013 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c8452-6150-406a-a567-0ee481265da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:15.770510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c8452-6150-406a-a567-0ee481265da1 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:15.784228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 154/314] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:15.785637 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238b8e1-71d3-43d9-ba30-02c57b528456 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:15.858417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:15.898832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238b8e1-71d3-43d9-ba30-02c57b528456 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:15.935598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5a082-e59d-45e8-ba8e-e1324e8f9871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:15.936268 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5a082-e59d-45e8-ba8e-e1324e8f9871 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:15.936549 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5a082-e59d-45e8-ba8e-e1324e8f9871 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:15.936825 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5a082-e59d-45e8-ba8e-e1324e8f9871 None admin] PATH_INFO: `/v3/users/bab87eb7a47942cebe0f33745da0e23f` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:15.938142 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5a082-e59d-45e8-ba8e-e1324e8f9871 None admin] RBAC: Authorizing `identity:get_user(user_id=bab87eb7a47942cebe0f33745da0e23f)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:15.939579 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5a082-e59d-45e8-ba8e-e1324e8f9871 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:15.941717 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 161/315] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:15 2022] GET /identity/v3/users/bab87eb7a47942cebe0f33745da0e23f => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:15.947407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c8452-6150-406a-a567-0ee481265da1 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:16.062748 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:16.070232 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c8452-6150-406a-a567-0ee481265da1 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:16.106408 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155e934-cb3c-4a43-a1e2-050c844ddc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:16.107022 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155e934-cb3c-4a43-a1e2-050c844ddc25 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:16.107304 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155e934-cb3c-4a43-a1e2-050c844ddc25 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:16.107579 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155e934-cb3c-4a43-a1e2-050c844ddc25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:16.181462 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155e934-cb3c-4a43-a1e2-050c844ddc25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:16.183314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155e934-cb3c-4a43-a1e2-050c844ddc25 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:16.280629 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:16.288124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 155/316] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:16.295232 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5a082-e59d-45e8-ba8e-e1324e8f9871 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:16.448140 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5a082-e59d-45e8-ba8e-e1324e8f9871 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:16.495853 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:16.503103 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ef547-ba1c-4d2c-b7b7-022956f8fb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:16.504235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ef547-ba1c-4d2c-b7b7-022956f8fb97 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:16.504834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ef547-ba1c-4d2c-b7b7-022956f8fb97 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:16.505279 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ef547-ba1c-4d2c-b7b7-022956f8fb97 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:16.507193 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ef547-ba1c-4d2c-b7b7-022956f8fb97 None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:16.510401 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ef547-ba1c-4d2c-b7b7-022956f8fb97 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:16.518203 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 162/317] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:16 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:16.523992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155e934-cb3c-4a43-a1e2-050c844ddc25 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:16.700463 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155e934-cb3c-4a43-a1e2-050c844ddc25 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:16.762135 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa285f-4011-49fc-b399-c73b566206dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:16.763149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa285f-4011-49fc-b399-c73b566206dd None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:16.763630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa285f-4011-49fc-b399-c73b566206dd None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:16.764112 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa285f-4011-49fc-b399-c73b566206dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:16.765590 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa285f-4011-49fc-b399-c73b566206dd None admin] RBAC: Adding query filter params (role.id=14b61ba15c6d439e986b2c111ae338e3, scope.project.id=8a98056efe76460d9e79ef3963745a2f, user.id=bab87eb7a47942cebe0f33745da0e23f) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:16.766164 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa285f-4011-49fc-b399-c73b566206dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:16.768845 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa285f-4011-49fc-b399-c73b566206dd None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:16.780034 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 156/318] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:33:16 2022] GET /identity/v3/role_assignments?user.id=bab87eb7a47942cebe0f33745da0e23f&scope.project.id=8a98056efe76460d9e79ef3963745a2f&role.id=14b61ba15c6d439e986b2c111ae338e3 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:17.061474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064803d2-2bbf-495f-8b6b-a8ce49b6479a None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:17.068473 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064803d2-2bbf-495f-8b6b-a8ce49b6479a None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:17.069113 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064803d2-2bbf-495f-8b6b-a8ce49b6479a None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:17.071712 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 163/319] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:17 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:17.080940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a64307-0000-43ab-98a8-6dbd1cb1539e None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:17.081438 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a64307-0000-43ab-98a8-6dbd1cb1539e None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:17.081979 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a64307-0000-43ab-98a8-6dbd1cb1539e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:17.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-c4a64307-0000-43ab-98a8-6dbd1cb1539e None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:17.112808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-c4a64307-0000-43ab-98a8-6dbd1cb1539e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:17.177751 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:17.190431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 157/320] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:17.412738 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd929d8-1554-4f02-b3be-84e57e83c198 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:17.412944 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd929d8-1554-4f02-b3be-84e57e83c198 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:17.413213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd929d8-1554-4f02-b3be-84e57e83c198 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:17.414576 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 164/321] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:17.419798 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096bd4d-2406-4abb-97e7-aa38b4536505 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:17.420080 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096bd4d-2406-4abb-97e7-aa38b4536505 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:17.420354 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096bd4d-2406-4abb-97e7-aa38b4536505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:17.439018 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-e096bd4d-2406-4abb-97e7-aa38b4536505 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:17.440178 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-e096bd4d-2406-4abb-97e7-aa38b4536505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:17.507913 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 158/322] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:17.516241 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd929d8-1554-4f02-b3be-84e57e83c198 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:17.618280 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adcf3f-44e0-42fe-b8b3-58ac5a9273b5 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:17.618631 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adcf3f-44e0-42fe-b8b3-58ac5a9273b5 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:17.618956 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adcf3f-44e0-42fe-b8b3-58ac5a9273b5 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:17.620571 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd929d8-1554-4f02-b3be-84e57e83c198 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:17.620693 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 159/323] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:17.626588 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea920474-301e-4f9e-aeb1-65ed97febc1d None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:17.627039 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea920474-301e-4f9e-aeb1-65ed97febc1d None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:17.627869 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea920474-301e-4f9e-aeb1-65ed97febc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:17.649070 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-ea920474-301e-4f9e-aeb1-65ed97febc1d None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:17.650466 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-ea920474-301e-4f9e-aeb1-65ed97febc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:17.657630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bb582-42d8-4981-8a64-2958a37e9cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:17.658296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bb582-42d8-4981-8a64-2958a37e9cbf None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:17.658578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bb582-42d8-4981-8a64-2958a37e9cbf None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:17.659254 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bb582-42d8-4981-8a64-2958a37e9cbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:17.660397 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bb582-42d8-4981-8a64-2958a37e9cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:17.662254 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bb582-42d8-4981-8a64-2958a37e9cbf None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:17.664298 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 165/324] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:17.669820 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bb582-42d8-4981-8a64-2958a37e9cbf None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:17.722590 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 160/325] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:33:17.742560 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:17.775342 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bb582-42d8-4981-8a64-2958a37e9cbf None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:17.808150 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd849ff-b180-4032-af19-0e9c2374d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:17.808755 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd849ff-b180-4032-af19-0e9c2374d193 None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:17.809035 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd849ff-b180-4032-af19-0e9c2374d193 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:17.809306 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd849ff-b180-4032-af19-0e9c2374d193 None admin] PATH_INFO: `/v3/groups` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:17.809960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd849ff-b180-4032-af19-0e9c2374d193 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:17.811415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd849ff-b180-4032-af19-0e9c2374d193 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:17.827142 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 166/326] 10.222.0.36 () {60 vars in 1134 bytes} [Sat Oct 8 20:33:17 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:33:17.830620 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea920474-301e-4f9e-aeb1-65ed97febc1d None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:17.889394 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:17.949483 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea920474-301e-4f9e-aeb1-65ed97febc1d None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:17.988251 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d98bc-1ca0-44f6-beae-f6a48fd403b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:17.988911 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d98bc-1ca0-44f6-beae-f6a48fd403b5 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:17.989181 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d98bc-1ca0-44f6-beae-f6a48fd403b5 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:17.989453 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d98bc-1ca0-44f6-beae-f6a48fd403b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:18.001148 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d98bc-1ca0-44f6-beae-f6a48fd403b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-759d98bc-1ca0-44f6-beae-f6a48fd403b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:18.006233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:18.007222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:18.008051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:18.008051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:18.008051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:18.008051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:18.008051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:18.008051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:18.008051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:18.008051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:18.008051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:18.008051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:18.008051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:33:18.008051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:18.008051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 161/327] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:18.013433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd849ff-b180-4032-af19-0e9c2374d193 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:18.057926 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d98bc-1ca0-44f6-beae-f6a48fd403b5 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:18.143663 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd849ff-b180-4032-af19-0e9c2374d193 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:18.175242 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:18.186093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7fe93-61ff-4995-a10e-63f9d5d5b4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:18.186754 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7fe93-61ff-4995-a10e-63f9d5d5b4ba None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:18.187039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7fe93-61ff-4995-a10e-63f9d5d5b4ba None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:18.187308 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7fe93-61ff-4995-a10e-63f9d5d5b4ba None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:18.188603 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7fe93-61ff-4995-a10e-63f9d5d5b4ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:18.188603 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7fe93-61ff-4995-a10e-63f9d5d5b4ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:18.188861 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d98bc-1ca0-44f6-beae-f6a48fd403b5 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:18.189689 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7fe93-61ff-4995-a10e-63f9d5d5b4ba None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:18.199688 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 167/328] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:18.201744 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:18.205372 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7fe93-61ff-4995-a10e-63f9d5d5b4ba None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:18.236873 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d52f73-4531-42cc-98f5-dd4b4f6e365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:18.237512 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d52f73-4531-42cc-98f5-dd4b4f6e365f None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:18.237794 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d52f73-4531-42cc-98f5-dd4b4f6e365f None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:18.238111 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d52f73-4531-42cc-98f5-dd4b4f6e365f None admin] PATH_INFO: `/v3/roles/member` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:18.253085 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d52f73-4531-42cc-98f5-dd4b4f6e365f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-49d52f73-4531-42cc-98f5-dd4b4f6e365f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:18.258107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:18.259041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:18.259844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:18.259844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:18.259844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:18.259844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:18.259844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:18.259844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:18.259844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:18.259844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:18.259844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:18.259844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:18.259844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:18.259844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:18.259844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 162/329] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:18.267099 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d52f73-4531-42cc-98f5-dd4b4f6e365f None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:18.338233 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7fe93-61ff-4995-a10e-63f9d5d5b4ba None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:18.382124 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a25ee9-2b1f-40be-8e25-d329e568275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:18.383021 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a25ee9-2b1f-40be-8e25-d329e568275c None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:18.383417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a25ee9-2b1f-40be-8e25-d329e568275c None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:18.383779 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a25ee9-2b1f-40be-8e25-d329e568275c None admin] PATH_INFO: `/v3/users/22ce60d801dd414aa1f3b4dd4df92a31` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:18.385028 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a25ee9-2b1f-40be-8e25-d329e568275c None admin] RBAC: Authorizing `identity:get_user(user_id=22ce60d801dd414aa1f3b4dd4df92a31)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:18.386869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a25ee9-2b1f-40be-8e25-d329e568275c None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:18.389535 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 168/330] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:18 2022] GET /identity/v3/users/22ce60d801dd414aa1f3b4dd4df92a31 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:18.395156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a25ee9-2b1f-40be-8e25-d329e568275c None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:18.412433 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d52f73-4531-42cc-98f5-dd4b4f6e365f None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:18.458408 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bc2ca-7a9c-4e1d-a83d-959f10fc073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:18.458938 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bc2ca-7a9c-4e1d-a83d-959f10fc073f None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:18.459220 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bc2ca-7a9c-4e1d-a83d-959f10fc073f None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:18.460379 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bc2ca-7a9c-4e1d-a83d-959f10fc073f None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:18.460379 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bc2ca-7a9c-4e1d-a83d-959f10fc073f None admin] RBAC: Adding query filter params (name=member) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:18.460663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bc2ca-7a9c-4e1d-a83d-959f10fc073f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:18.461819 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bc2ca-7a9c-4e1d-a83d-959f10fc073f None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:18.478429 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:18.481979 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 163/331] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:18.490218 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bc2ca-7a9c-4e1d-a83d-959f10fc073f None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:18.549209 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a25ee9-2b1f-40be-8e25-d329e568275c None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:18.549728 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:18.594861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee78f4-4d9b-4b4c-a07c-f015374300d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:18.595891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee78f4-4d9b-4b4c-a07c-f015374300d2 None admin] REQUEST_METHOD: `PUT` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:18.596363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee78f4-4d9b-4b4c-a07c-f015374300d2 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:18.596837 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee78f4-4d9b-4b4c-a07c-f015374300d2 None admin] PATH_INFO: `/v3/system/users/22ce60d801dd414aa1f3b4dd4df92a31/roles/14b61ba15c6d439e986b2c111ae338e3` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:18.598562 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee78f4-4d9b-4b4c-a07c-f015374300d2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=22ce60d801dd414aa1f3b4dd4df92a31, role_id=14b61ba15c6d439e986b2c111ae338e3)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:18.600197 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee78f4-4d9b-4b4c-a07c-f015374300d2 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:18.612034 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 169/332] 10.222.0.36 () {58 vars in 1334 bytes} [Sat Oct 8 20:33:18 2022] PUT /identity/v3/system/users/22ce60d801dd414aa1f3b4dd4df92a31/roles/14b61ba15c6d439e986b2c111ae338e3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:33:18.699683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bc2ca-7a9c-4e1d-a83d-959f10fc073f None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:18.766666 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dafa1-3063-4e04-b5fc-b3a9d8726b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:18.767790 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dafa1-3063-4e04-b5fc-b3a9d8726b5b None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:18.768279 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dafa1-3063-4e04-b5fc-b3a9d8726b5b None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:18.768751 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dafa1-3063-4e04-b5fc-b3a9d8726b5b None admin] PATH_INFO: `/v3/users/7b51a9a8b8fd4b31a2da908acc13c279` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:18.771327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764dafa1-3063-4e04-b5fc-b3a9d8726b5b None admin] RBAC: Authorizing `identity:get_user(user_id=7b51a9a8b8fd4b31a2da908acc13c279)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:18.774066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764dafa1-3063-4e04-b5fc-b3a9d8726b5b None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:18.777424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 164/333] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:18 2022] GET /identity/v3/users/7b51a9a8b8fd4b31a2da908acc13c279 => generated 293 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:18.786903 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee78f4-4d9b-4b4c-a07c-f015374300d2 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:18.934074 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee78f4-4d9b-4b4c-a07c-f015374300d2 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:18.959977 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:18.971726 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4416dc8-88c6-446d-bb55-0e5050e7b655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:18.973360 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4416dc8-88c6-446d-bb55-0e5050e7b655 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:18.974385 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4416dc8-88c6-446d-bb55-0e5050e7b655 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:18.974671 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4416dc8-88c6-446d-bb55-0e5050e7b655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:18.975488 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4416dc8-88c6-446d-bb55-0e5050e7b655 None admin] RBAC: Adding query filter params (role.id=fc58707301804afca34ac8fe194639ed, user.id=7b51a9a8b8fd4b31a2da908acc13c279, scope.system=all) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:18.976289 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4416dc8-88c6-446d-bb55-0e5050e7b655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:18.977343 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4416dc8-88c6-446d-bb55-0e5050e7b655 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:18.991452 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 170/334] 10.222.0.36 () {56 vars in 1308 bytes} [Sat Oct 8 20:33:18 2022] GET /identity/v3/role_assignments?user.id=7b51a9a8b8fd4b31a2da908acc13c279&scope.system=all&role.id=fc58707301804afca34ac8fe194639ed => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:21.215020 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a64556-6c0d-4d1d-8b9d-1ac5ace367d5 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:21.215518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a64556-6c0d-4d1d-8b9d-1ac5ace367d5 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:21.215592 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a64556-6c0d-4d1d-8b9d-1ac5ace367d5 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:21.217164 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 165/335] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:21.222405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2e4dc-f2ce-4129-bb72-7d81d3131afd None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:21.223960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2e4dc-f2ce-4129-bb72-7d81d3131afd None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:21.224451 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2e4dc-f2ce-4129-bb72-7d81d3131afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:21.250998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-7bd2e4dc-f2ce-4129-bb72-7d81d3131afd None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:21.252549 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-7bd2e4dc-f2ce-4129-bb72-7d81d3131afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:21.336277 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 171/336] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:21.530178 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62afe7-21c2-469b-be03-bc7c429dbe6b None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:21.530865 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62afe7-21c2-469b-be03-bc7c429dbe6b None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:21.531371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62afe7-21c2-469b-be03-bc7c429dbe6b None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:21.532983 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 166/337] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:21.539119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239e5f2-1d43-434b-a275-a23d79f27a15 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:21.539735 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239e5f2-1d43-434b-a275-a23d79f27a15 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:21.540219 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239e5f2-1d43-434b-a275-a23d79f27a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:21.570905 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-6239e5f2-1d43-434b-a275-a23d79f27a15 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:21.572453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-6239e5f2-1d43-434b-a275-a23d79f27a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:21.652519 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 172/338] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:21.843541 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62afe7-21c2-469b-be03-bc7c429dbe6b None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:21.967371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:21.971247 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62afe7-21c2-469b-be03-bc7c429dbe6b None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:22.012282 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacb032-85b3-4df6-999c-973b14df8afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:22.012910 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacb032-85b3-4df6-999c-973b14df8afd None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:22.013188 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacb032-85b3-4df6-999c-973b14df8afd None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:22.013460 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacb032-85b3-4df6-999c-973b14df8afd None admin] PATH_INFO: `/v3/roles/member` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:22.030830 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacb032-85b3-4df6-999c-973b14df8afd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-faacb032-85b3-4df6-999c-973b14df8afd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:22.036157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:22.037051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:22.037840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:22.037840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:22.037840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:22.037840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:22.037840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:22.037840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:22.037840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:22.037840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:22.037840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:22.037840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:22.037840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:22.037840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:22.037840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 167/339] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:22.044932 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239e5f2-1d43-434b-a275-a23d79f27a15 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:22.047579 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a6f2a-cb4b-4e5a-b0ca-051e90712de5 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:22.047866 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a6f2a-cb4b-4e5a-b0ca-051e90712de5 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:22.048143 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a6f2a-cb4b-4e5a-b0ca-051e90712de5 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:22.066952 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 168/340] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:22 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:33:22.068508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde3271-b5fe-48ca-8d25-577a031cbf5f None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:22.068796 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde3271-b5fe-48ca-8d25-577a031cbf5f None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:22.069069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde3271-b5fe-48ca-8d25-577a031cbf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:22.095531 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-5cde3271-b5fe-48ca-8d25-577a031cbf5f None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:22.096777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-5cde3271-b5fe-48ca-8d25-577a031cbf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:22.151058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:22.214905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 169/341] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:22.215769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde3271-b5fe-48ca-8d25-577a031cbf5f None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:22.244349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239e5f2-1d43-434b-a275-a23d79f27a15 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:22.295050 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ef23b-91c9-4567-9b51-af540ae8e42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:22.295672 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ef23b-91c9-4567-9b51-af540ae8e42a None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:22.295964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ef23b-91c9-4567-9b51-af540ae8e42a None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:22.296230 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ef23b-91c9-4567-9b51-af540ae8e42a None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:22.296893 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ef23b-91c9-4567-9b51-af540ae8e42a None admin] RBAC: Adding query filter params (name=member) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:22.297199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ef23b-91c9-4567-9b51-af540ae8e42a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:22.298625 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ef23b-91c9-4567-9b51-af540ae8e42a None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:22.312456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 173/342] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:22.319595 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ef23b-91c9-4567-9b51-af540ae8e42a None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:22.397920 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:22.416094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde3271-b5fe-48ca-8d25-577a031cbf5f None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:22.492076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede047ad-d5ad-4dd0-ba2a-67cd4ddf8587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:22.492737 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede047ad-d5ad-4dd0-ba2a-67cd4ddf8587 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:22.493019 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede047ad-d5ad-4dd0-ba2a-67cd4ddf8587 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:22.493291 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede047ad-d5ad-4dd0-ba2a-67cd4ddf8587 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:22.520912 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede047ad-d5ad-4dd0-ba2a-67cd4ddf8587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-ede047ad-d5ad-4dd0-ba2a-67cd4ddf8587 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:22.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:22.527683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:22.528496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:22.528496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:22.528496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:22.528496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:22.528496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:22.528496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:22.528496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:22.528496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:22.528496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:22.528496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:22.528496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:22.528496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:22.534721 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ef23b-91c9-4567-9b51-af540ae8e42a None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:22.536758 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 170/343] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:33:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:22.538546 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228fd1f-db0d-4fa2-b019-bd686f2565ac None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:22.538835 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228fd1f-db0d-4fa2-b019-bd686f2565ac None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:22.539109 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228fd1f-db0d-4fa2-b019-bd686f2565ac None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:22.540750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:22.544282 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 171/344] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:22.547562 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3bfe5-4fb0-4f84-a8b4-7d25ac7d26d2 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:22.547972 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3bfe5-4fb0-4f84-a8b4-7d25ac7d26d2 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:22.548253 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3bfe5-4fb0-4f84-a8b4-7d25ac7d26d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:22.577184 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-f9a3bfe5-4fb0-4f84-a8b4-7d25ac7d26d2 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:22.578417 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-f9a3bfe5-4fb0-4f84-a8b4-7d25ac7d26d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:22.617392 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c0cdc-3968-46d9-a076-abf1c8402762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:22.618071 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c0cdc-3968-46d9-a076-abf1c8402762 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:22.618357 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c0cdc-3968-46d9-a076-abf1c8402762 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:22.618632 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c0cdc-3968-46d9-a076-abf1c8402762 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:22.677702 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 172/345] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:22.679094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3bfe5-4fb0-4f84-a8b4-7d25ac7d26d2 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:22.769658 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c0cdc-3968-46d9-a076-abf1c8402762 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:22.771433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c0cdc-3968-46d9-a076-abf1c8402762 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:22.817828 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:22.854416 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3bfe5-4fb0-4f84-a8b4-7d25ac7d26d2 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:22.907737 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ada10-8fd1-497b-b72c-76237385fe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:22.908356 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ada10-8fd1-497b-b72c-76237385fe21 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:22.908640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ada10-8fd1-497b-b72c-76237385fe21 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:22.908916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ada10-8fd1-497b-b72c-76237385fe21 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:22.909866 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ada10-8fd1-497b-b72c-76237385fe21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:22.911712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ada10-8fd1-497b-b72c-76237385fe21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:22.912008 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ada10-8fd1-497b-b72c-76237385fe21 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:22.922405 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 173/346] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:22.923203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ada10-8fd1-497b-b72c-76237385fe21 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:22.952044 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 174/347] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:33:22.953763 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c0cdc-3968-46d9-a076-abf1c8402762 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:22.957086 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:23.067394 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c0cdc-3968-46d9-a076-abf1c8402762 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:23.109934 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef31f5-537c-47b5-a6de-f23d285237fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:23.111326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef31f5-537c-47b5-a6de-f23d285237fd None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:23.111326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef31f5-537c-47b5-a6de-f23d285237fd None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:23.111326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef31f5-537c-47b5-a6de-f23d285237fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:23.120840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ada10-8fd1-497b-b72c-76237385fe21 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:23.163354 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cf664-3d30-4c8c-8104-82554272e9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:23.164417 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cf664-3d30-4c8c-8104-82554272e9eb None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:23.164961 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cf664-3d30-4c8c-8104-82554272e9eb None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:23.165534 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cf664-3d30-4c8c-8104-82554272e9eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:23.179724 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cf664-3d30-4c8c-8104-82554272e9eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-608cf664-3d30-4c8c-8104-82554272e9eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:23.186084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:23.187149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:23.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:23.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:23.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:23.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:23.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:23.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:23.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:23.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:23.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:23.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:23.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:23.188128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:23.190767 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 174/348] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:23.197753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cf664-3d30-4c8c-8104-82554272e9eb None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:23.201005 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:23.203269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef31f5-537c-47b5-a6de-f23d285237fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:23.204768 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef31f5-537c-47b5-a6de-f23d285237fd None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:23.211063 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:23.336983 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cf664-3d30-4c8c-8104-82554272e9eb None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:23.345600 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 175/349] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:23.347956 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15cf43-778a-4171-a93e-1303db6e0088 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:23.348433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15cf43-778a-4171-a93e-1303db6e0088 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:23.348887 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15cf43-778a-4171-a93e-1303db6e0088 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:23.352314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 176/350] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:23.353266 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15cf43-778a-4171-a93e-1303db6e0088 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:23.379404 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72906b7-a34e-41d7-a381-fee0b4b30332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:23.380190 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72906b7-a34e-41d7-a381-fee0b4b30332 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:23.380811 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72906b7-a34e-41d7-a381-fee0b4b30332 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:23.380936 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72906b7-a34e-41d7-a381-fee0b4b30332 None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:23.383202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72906b7-a34e-41d7-a381-fee0b4b30332 None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:23.384767 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72906b7-a34e-41d7-a381-fee0b4b30332 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:23.387075 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 175/351] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:23 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:23.387713 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72906b7-a34e-41d7-a381-fee0b4b30332 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:23.475480 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:23.477028 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15cf43-778a-4171-a93e-1303db6e0088 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:23.479119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:23.524329 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72906b7-a34e-41d7-a381-fee0b4b30332 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:23.525581 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653d8e0-e039-4b13-9db3-267463fac345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:23.526262 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653d8e0-e039-4b13-9db3-267463fac345 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:23.526538 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653d8e0-e039-4b13-9db3-267463fac345 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:23.526808 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653d8e0-e039-4b13-9db3-267463fac345 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:23.539771 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653d8e0-e039-4b13-9db3-267463fac345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-1653d8e0-e039-4b13-9db3-267463fac345 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:23.545156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:23.546122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:23.546966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:23.546966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:23.546966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:23.546966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:23.546966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:23.546966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:23.546966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:23.546966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:23.546966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:23.546966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:23.546966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 08 20:33:23.546966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:23.549198 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 177/352] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:23.550209 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653d8e0-e039-4b13-9db3-267463fac345 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:23.565070 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43972c87-f88d-494a-b2e9-264878eb9402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:23.566108 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43972c87-f88d-494a-b2e9-264878eb9402 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:23.566641 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43972c87-f88d-494a-b2e9-264878eb9402 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:23.567123 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43972c87-f88d-494a-b2e9-264878eb9402 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:23.567983 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43972c87-f88d-494a-b2e9-264878eb9402 None admin] RBAC: Adding query filter params (name=member) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:23.568490 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43972c87-f88d-494a-b2e9-264878eb9402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:23.570244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43972c87-f88d-494a-b2e9-264878eb9402 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:23.579450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 176/353] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:23.581034 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebf1be-2d5e-414b-a44d-fa731c62f875 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:23.581321 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebf1be-2d5e-414b-a44d-fa731c62f875 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:23.581594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebf1be-2d5e-414b-a44d-fa731c62f875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:23.602326 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-47ebf1be-2d5e-414b-a44d-fa731c62f875 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:23.603436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-47ebf1be-2d5e-414b-a44d-fa731c62f875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:23.680029 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653d8e0-e039-4b13-9db3-267463fac345 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:23.680948 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 177/354] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:23.681598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebf1be-2d5e-414b-a44d-fa731c62f875 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:23.727262 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9a6fc-8b74-4e96-a64b-63195ef59fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:23.727997 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9a6fc-8b74-4e96-a64b-63195ef59fae None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:23.728576 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9a6fc-8b74-4e96-a64b-63195ef59fae None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:23.728576 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9a6fc-8b74-4e96-a64b-63195ef59fae None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:23.733068 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9a6fc-8b74-4e96-a64b-63195ef59fae None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:23.733068 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9a6fc-8b74-4e96-a64b-63195ef59fae None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:23.733431 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 178/355] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:23 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:23.734625 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9a6fc-8b74-4e96-a64b-63195ef59fae None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:23.764829 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:23.767843 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:23.812214 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebf1be-2d5e-414b-a44d-fa731c62f875 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:23.860695 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9a6fc-8b74-4e96-a64b-63195ef59fae None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:23.867436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959ecc5-ffc4-4207-b550-a96fdbe148c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:23.868081 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959ecc5-ffc4-4207-b550-a96fdbe148c2 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:23.868363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959ecc5-ffc4-4207-b550-a96fdbe148c2 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:23.868639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959ecc5-ffc4-4207-b550-a96fdbe148c2 None admin] PATH_INFO: `/v3/groups/21a98ebc20b4444a8e490b2a087edc4a` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:23.878666 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959ecc5-ffc4-4207-b550-a96fdbe148c2 None admin] RBAC: Authorizing `identity:get_group(group_id=21a98ebc20b4444a8e490b2a087edc4a)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:23.881222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959ecc5-ffc4-4207-b550-a96fdbe148c2 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:23.883659 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 178/356] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Oct 8 20:33:23 2022] GET /identity/v3/groups/21a98ebc20b4444a8e490b2a087edc4a => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:23.884714 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959ecc5-ffc4-4207-b550-a96fdbe148c2 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:23.898578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f7b23-0254-4adf-b843-804426bb0073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:23.899129 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f7b23-0254-4adf-b843-804426bb0073 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:23.899407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f7b23-0254-4adf-b843-804426bb0073 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:23.899677 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f7b23-0254-4adf-b843-804426bb0073 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:23.900337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f7b23-0254-4adf-b843-804426bb0073 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:23.900637 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f7b23-0254-4adf-b843-804426bb0073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:23.902049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f7b23-0254-4adf-b843-804426bb0073 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:23.911792 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 179/357] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:23.913513 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afb7de-f3dd-4ce5-b9c6-661b482a2492 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:23.913914 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afb7de-f3dd-4ce5-b9c6-661b482a2492 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:23.914270 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afb7de-f3dd-4ce5-b9c6-661b482a2492 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:23.915680 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 180/358] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:23.916375 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afb7de-f3dd-4ce5-b9c6-661b482a2492 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:24.031791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959ecc5-ffc4-4207-b550-a96fdbe148c2 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:24.042182 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:24.058975 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afb7de-f3dd-4ce5-b9c6-661b482a2492 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:24.072075 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:24.082444 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185eca9-b20b-4658-8be8-35483601fe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:24.084532 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185eca9-b20b-4658-8be8-35483601fe38 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:24.084973 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185eca9-b20b-4658-8be8-35483601fe38 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:24.085252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185eca9-b20b-4658-8be8-35483601fe38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:24.103254 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36f06c-3437-4f94-b925-6dadf5d835c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:24.104449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f06c-3437-4f94-b925-6dadf5d835c9 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:24.104449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f06c-3437-4f94-b925-6dadf5d835c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:24.104639 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f06c-3437-4f94-b925-6dadf5d835c9 None admin] PATH_INFO: `/v3/groups/21a98ebc20b4444a8e490b2a087edc4a` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:24.106562 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36f06c-3437-4f94-b925-6dadf5d835c9 None admin] RBAC: Authorizing `identity:get_group(group_id=21a98ebc20b4444a8e490b2a087edc4a)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:24.107990 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36f06c-3437-4f94-b925-6dadf5d835c9 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:24.109840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 181/359] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Oct 8 20:33:23 2022] GET /identity/v3/groups/21a98ebc20b4444a8e490b2a087edc4a => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:24.110681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36f06c-3437-4f94-b925-6dadf5d835c9 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:24.169634 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185eca9-b20b-4658-8be8-35483601fe38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:24.171075 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185eca9-b20b-4658-8be8-35483601fe38 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:24.231459 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36f06c-3437-4f94-b925-6dadf5d835c9 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:24.272532 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ec37c-908e-473b-8dae-720714b1c23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:24.273144 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ec37c-908e-473b-8dae-720714b1c23b None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:24.273717 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ec37c-908e-473b-8dae-720714b1c23b None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:24.274017 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ec37c-908e-473b-8dae-720714b1c23b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:24.274743 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ec37c-908e-473b-8dae-720714b1c23b None admin] RBAC: Adding query filter params (group.id=21a98ebc20b4444a8e490b2a087edc4a, role.id=fc58707301804afca34ac8fe194639ed, scope.project.id=eaae93f262bf474db3770d3977f5e228) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:24.275046 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ec37c-908e-473b-8dae-720714b1c23b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:24.276882 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ec37c-908e-473b-8dae-720714b1c23b None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:24.283432 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 182/360] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Oct 8 20:33:24 2022] GET /identity/v3/role_assignments?group.id=21a98ebc20b4444a8e490b2a087edc4a&scope.project.id=eaae93f262bf474db3770d3977f5e228&role.id=fc58707301804afca34ac8fe194639ed => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:24.284200 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ec37c-908e-473b-8dae-720714b1c23b None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:24.295446 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 179/361] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:24.296877 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e81ff7-8490-4319-b9fe-ad016cb715c6 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:24.297575 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e81ff7-8490-4319-b9fe-ad016cb715c6 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:24.297851 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e81ff7-8490-4319-b9fe-ad016cb715c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:24.314930 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:24.321684 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-a8e81ff7-8490-4319-b9fe-ad016cb715c6 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:24.323109 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-a8e81ff7-8490-4319-b9fe-ad016cb715c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:24.348120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:24.420865 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ec37c-908e-473b-8dae-720714b1c23b None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:24.421946 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 180/362] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:24.423234 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e81ff7-8490-4319-b9fe-ad016cb715c6 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:24.475514 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f37da-9afb-4bbd-bb86-db30fa2f54f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:24.476237 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f37da-9afb-4bbd-bb86-db30fa2f54f5 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:24.476522 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f37da-9afb-4bbd-bb86-db30fa2f54f5 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:24.476797 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f37da-9afb-4bbd-bb86-db30fa2f54f5 None admin] PATH_INFO: `/v3/users/22ce60d801dd414aa1f3b4dd4df92a31` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:24.478055 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f37da-9afb-4bbd-bb86-db30fa2f54f5 None admin] RBAC: Authorizing `identity:get_user(user_id=22ce60d801dd414aa1f3b4dd4df92a31)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:24.481308 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f37da-9afb-4bbd-bb86-db30fa2f54f5 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:24.482791 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 183/363] 10.222.0.36 () {56 vars in 1177 bytes} [Sat Oct 8 20:33:24 2022] GET /identity/v3/users/22ce60d801dd414aa1f3b4dd4df92a31 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:24.486372 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f37da-9afb-4bbd-bb86-db30fa2f54f5 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:24.576625 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e81ff7-8490-4319-b9fe-ad016cb715c6 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:24.599472 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:24.612602 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f37da-9afb-4bbd-bb86-db30fa2f54f5 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:24.629983 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0c09f-1a06-4534-8489-5a505f62f050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:24.631486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0c09f-1a06-4534-8489-5a505f62f050 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:24.632039 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0c09f-1a06-4534-8489-5a505f62f050 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:24.632498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0c09f-1a06-4534-8489-5a505f62f050 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:24.651396 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0c09f-1a06-4534-8489-5a505f62f050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:24.657066 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92945f2-83d6-4c8f-aa37-d76a283fe003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-fdd0c09f-1a06-4534-8489-5a505f62f050 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:24.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:24.658467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:24.659445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:24.659445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:24.659445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:24.659445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:24.659445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:24.659445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:24.659445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:24.659445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:24.659445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:24.659445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:24.659445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:24.659445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:24.660234 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92945f2-83d6-4c8f-aa37-d76a283fe003 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:24.660234 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92945f2-83d6-4c8f-aa37-d76a283fe003 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:24.660234 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92945f2-83d6-4c8f-aa37-d76a283fe003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:24.660234 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92945f2-83d6-4c8f-aa37-d76a283fe003 None admin] RBAC: Adding query filter params (group.id=21a98ebc20b4444a8e490b2a087edc4a, role.id=04e5ea25342a4845b0df239f7f2b0705, scope.project.id=eaae93f262bf474db3770d3977f5e228) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:24.660234 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92945f2-83d6-4c8f-aa37-d76a283fe003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:24.661028 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92945f2-83d6-4c8f-aa37-d76a283fe003 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:24.662276 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 181/364] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:33:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:24.663628 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0c09f-1a06-4534-8489-5a505f62f050 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:24.667233 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 184/365] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Oct 8 20:33:24 2022] GET /identity/v3/role_assignments?group.id=21a98ebc20b4444a8e490b2a087edc4a&scope.project.id=eaae93f262bf474db3770d3977f5e228&role.id=04e5ea25342a4845b0df239f7f2b0705 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:24.668047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92945f2-83d6-4c8f-aa37-d76a283fe003 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:24.687782 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:24.795975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0c09f-1a06-4534-8489-5a505f62f050 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:24.847898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29e5f1-be96-4147-a07a-0ff0ff914b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:24.849072 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29e5f1-be96-4147-a07a-0ff0ff914b7a None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:24.849496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29e5f1-be96-4147-a07a-0ff0ff914b7a None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:24.850052 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29e5f1-be96-4147-a07a-0ff0ff914b7a None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:24.850516 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92945f2-83d6-4c8f-aa37-d76a283fe003 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:24.851610 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29e5f1-be96-4147-a07a-0ff0ff914b7a None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:24.854662 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29e5f1-be96-4147-a07a-0ff0ff914b7a None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:24.862051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 182/366] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:24 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:24.863557 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29e5f1-be96-4147-a07a-0ff0ff914b7a None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:24.896420 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240270eb-1c0d-4f16-b8cb-f79bebe90828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:24.897075 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240270eb-1c0d-4f16-b8cb-f79bebe90828 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:24.897360 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240270eb-1c0d-4f16-b8cb-f79bebe90828 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:24.897785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240270eb-1c0d-4f16-b8cb-f79bebe90828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:24.898564 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240270eb-1c0d-4f16-b8cb-f79bebe90828 None admin] RBAC: Adding query filter params (role.id=14b61ba15c6d439e986b2c111ae338e3, user.id=22ce60d801dd414aa1f3b4dd4df92a31, scope.system=all) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:24.898876 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240270eb-1c0d-4f16-b8cb-f79bebe90828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:24.900348 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240270eb-1c0d-4f16-b8cb-f79bebe90828 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:24.916250 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 185/367] 10.222.0.36 () {56 vars in 1308 bytes} [Sat Oct 8 20:33:24 2022] GET /identity/v3/role_assignments?user.id=22ce60d801dd414aa1f3b4dd4df92a31&scope.system=all&role.id=14b61ba15c6d439e986b2c111ae338e3 => generated 510 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:24.917114 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240270eb-1c0d-4f16-b8cb-f79bebe90828 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:24.951560 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:24.983596 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:25.008021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29e5f1-be96-4147-a07a-0ff0ff914b7a None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:25.051144 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c0a3f-2434-4b7a-8cdc-52601fec7d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:25.052495 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c0a3f-2434-4b7a-8cdc-52601fec7d39 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:25.052965 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c0a3f-2434-4b7a-8cdc-52601fec7d39 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:25.053450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c0a3f-2434-4b7a-8cdc-52601fec7d39 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:25.060354 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c0a3f-2434-4b7a-8cdc-52601fec7d39 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:25.061080 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c0a3f-2434-4b7a-8cdc-52601fec7d39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:25.062950 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c0a3f-2434-4b7a-8cdc-52601fec7d39 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:25.074602 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 183/368] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:25.075988 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c0a3f-2434-4b7a-8cdc-52601fec7d39 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:25.132376 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240270eb-1c0d-4f16-b8cb-f79bebe90828 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:25.183852 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91b3c2-598d-4a4d-be61-3d76f7438e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:25.184577 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91b3c2-598d-4a4d-be61-3d76f7438e5d None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:25.184801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91b3c2-598d-4a4d-be61-3d76f7438e5d None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:25.185062 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91b3c2-598d-4a4d-be61-3d76f7438e5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:25.193398 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c0a3f-2434-4b7a-8cdc-52601fec7d39 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:25.196879 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91b3c2-598d-4a4d-be61-3d76f7438e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-2a91b3c2-598d-4a4d-be61-3d76f7438e5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:25.202444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:25.203388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:25.204213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:25.204213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:25.204213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:25.204213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:25.204213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:25.204213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:25.204213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:25.204213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:25.204213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:25.204213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:25.204213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:33:25.204213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:25.204213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 186/369] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:33:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:25.204900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91b3c2-598d-4a4d-be61-3d76f7438e5d None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:25.241806 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329aefc2-23fe-41a5-ac15-5eccc00033c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:25.242831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329aefc2-23fe-41a5-ac15-5eccc00033c9 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:25.243322 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329aefc2-23fe-41a5-ac15-5eccc00033c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:25.243853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329aefc2-23fe-41a5-ac15-5eccc00033c9 None admin] PATH_INFO: `/v3/groups/21a98ebc20b4444a8e490b2a087edc4a` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:25.246294 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329aefc2-23fe-41a5-ac15-5eccc00033c9 None admin] RBAC: Authorizing `identity:get_group(group_id=21a98ebc20b4444a8e490b2a087edc4a)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:25.248110 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329aefc2-23fe-41a5-ac15-5eccc00033c9 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:25.254326 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 184/370] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Oct 8 20:33:25 2022] GET /identity/v3/groups/21a98ebc20b4444a8e490b2a087edc4a => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:25.255624 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329aefc2-23fe-41a5-ac15-5eccc00033c9 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:25.283216 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:25.301590 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:25.332899 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91b3c2-598d-4a4d-be61-3d76f7438e5d None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:25.374944 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a6804-aba6-4013-8206-a5986c354c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:25.375571 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a6804-aba6-4013-8206-a5986c354c29 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:25.375845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a6804-aba6-4013-8206-a5986c354c29 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:25.376128 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a6804-aba6-4013-8206-a5986c354c29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:25.381907 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329aefc2-23fe-41a5-ac15-5eccc00033c9 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:25.420753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c3ce7-eacb-4827-b928-d189847b6ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:25.421740 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c3ce7-eacb-4827-b928-d189847b6ffa None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:25.422194 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c3ce7-eacb-4827-b928-d189847b6ffa None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:25.422464 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c3ce7-eacb-4827-b928-d189847b6ffa None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:25.423184 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c3ce7-eacb-4827-b928-d189847b6ffa None admin] RBAC: Adding query filter params (name=admin) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:25.423486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c3ce7-eacb-4827-b928-d189847b6ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:25.424887 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c3ce7-eacb-4827-b928-d189847b6ffa None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:25.435627 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 185/371] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:25.436598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c3ce7-eacb-4827-b928-d189847b6ffa None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:25.456038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a6804-aba6-4013-8206-a5986c354c29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:25.457747 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a6804-aba6-4013-8206-a5986c354c29 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:25.543666 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:25.544983 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:25.560645 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c3ce7-eacb-4827-b928-d189847b6ffa None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:25.574975 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 187/372] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:25.576079 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a6804-aba6-4013-8206-a5986c354c29 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:25.605143 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f551c7-d1ae-417e-9b81-87d91aa077a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:25.605762 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f551c7-d1ae-417e-9b81-87d91aa077a0 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:25.606069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f551c7-d1ae-417e-9b81-87d91aa077a0 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:25.606343 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f551c7-d1ae-417e-9b81-87d91aa077a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:25.607319 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f551c7-d1ae-417e-9b81-87d91aa077a0 None admin] RBAC: Adding query filter params (group.id=21a98ebc20b4444a8e490b2a087edc4a, role.id=fc58707301804afca34ac8fe194639ed, scope.project.id=8a98056efe76460d9e79ef3963745a2f) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:25.607628 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f551c7-d1ae-417e-9b81-87d91aa077a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:25.610002 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f551c7-d1ae-417e-9b81-87d91aa077a0 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:25.622017 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 186/373] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Oct 8 20:33:25 2022] GET /identity/v3/role_assignments?group.id=21a98ebc20b4444a8e490b2a087edc4a&scope.project.id=8a98056efe76460d9e79ef3963745a2f&role.id=fc58707301804afca34ac8fe194639ed => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:25.623289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f551c7-d1ae-417e-9b81-87d91aa077a0 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:25.761328 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a6804-aba6-4013-8206-a5986c354c29 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:25.835999 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f551c7-d1ae-417e-9b81-87d91aa077a0 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:25.839578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d839fb0-960c-4718-9f7b-e1cb0a10d277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:25.840536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d839fb0-960c-4718-9f7b-e1cb0a10d277 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:25.841017 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d839fb0-960c-4718-9f7b-e1cb0a10d277 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:25.841522 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d839fb0-960c-4718-9f7b-e1cb0a10d277 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:25.905596 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969034f9-d948-4a56-bfdf-e33f89c028ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:25.906663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969034f9-d948-4a56-bfdf-e33f89c028ca None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:25.907169 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969034f9-d948-4a56-bfdf-e33f89c028ca None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:25.907639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969034f9-d948-4a56-bfdf-e33f89c028ca None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:25.909000 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969034f9-d948-4a56-bfdf-e33f89c028ca None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:25.910879 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969034f9-d948-4a56-bfdf-e33f89c028ca None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:25.913054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 187/374] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:25 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:25.914538 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:25.918350 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969034f9-d948-4a56-bfdf-e33f89c028ca None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:25.938776 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:25.956231 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d839fb0-960c-4718-9f7b-e1cb0a10d277 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:25.958588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d839fb0-960c-4718-9f7b-e1cb0a10d277 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:26.078709 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969034f9-d948-4a56-bfdf-e33f89c028ca None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:26.126661 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cc2e5-26e4-4c39-9668-a0bb8958f6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:26.128054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cc2e5-26e4-4c39-9668-a0bb8958f6c2 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:26.128661 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cc2e5-26e4-4c39-9668-a0bb8958f6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:26.129612 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cc2e5-26e4-4c39-9668-a0bb8958f6c2 None admin] PATH_INFO: `/v3/groups/21a98ebc20b4444a8e490b2a087edc4a` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:26.130990 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cc2e5-26e4-4c39-9668-a0bb8958f6c2 None admin] RBAC: Authorizing `identity:get_group(group_id=21a98ebc20b4444a8e490b2a087edc4a)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:26.132579 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cc2e5-26e4-4c39-9668-a0bb8958f6c2 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:26.134816 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 188/375] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Oct 8 20:33:25 2022] GET /identity/v3/groups/21a98ebc20b4444a8e490b2a087edc4a => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:26.147882 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cc2e5-26e4-4c39-9668-a0bb8958f6c2 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:26.168982 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 188/376] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:26.174399 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d839fb0-960c-4718-9f7b-e1cb0a10d277 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:26.267000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:26.296703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:26.299153 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d839fb0-960c-4718-9f7b-e1cb0a10d277 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:26.338141 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b900929-b17a-442d-a20c-a111bba53398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:26.339002 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b900929-b17a-442d-a20c-a111bba53398 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:26.339539 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b900929-b17a-442d-a20c-a111bba53398 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:26.339980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b900929-b17a-442d-a20c-a111bba53398 None admin] PATH_INFO: `/v3/projects/552b2e45ebde4268bba84c6dbc8036cb` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:26.341305 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b900929-b17a-442d-a20c-a111bba53398 None admin] RBAC: Authorizing `identity:get_project(project_id=552b2e45ebde4268bba84c6dbc8036cb)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:26.343579 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b900929-b17a-442d-a20c-a111bba53398 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:26.345686 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 189/377] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:26 2022] GET /identity/v3/projects/552b2e45ebde4268bba84c6dbc8036cb => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:26.351179 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b900929-b17a-442d-a20c-a111bba53398 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:26.359487 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cc2e5-26e4-4c39-9668-a0bb8958f6c2 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:26.434356 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e5c8-b508-4e96-a6a7-0cf269474a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:26.434969 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e5c8-b508-4e96-a6a7-0cf269474a24 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:26.435244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e5c8-b508-4e96-a6a7-0cf269474a24 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:26.435521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e5c8-b508-4e96-a6a7-0cf269474a24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:26.436255 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971e5c8-b508-4e96-a6a7-0cf269474a24 None admin] RBAC: Adding query filter params (group.id=21a98ebc20b4444a8e490b2a087edc4a, role.id=04e5ea25342a4845b0df239f7f2b0705, scope.project.id=8a98056efe76460d9e79ef3963745a2f) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:26.436568 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971e5c8-b508-4e96-a6a7-0cf269474a24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:26.438037 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971e5c8-b508-4e96-a6a7-0cf269474a24 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:26.458293 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 189/378] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Oct 8 20:33:26 2022] GET /identity/v3/role_assignments?group.id=21a98ebc20b4444a8e490b2a087edc4a&scope.project.id=8a98056efe76460d9e79ef3963745a2f&role.id=04e5ea25342a4845b0df239f7f2b0705 => generated 260 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:26.505840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b900929-b17a-442d-a20c-a111bba53398 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:26.552758 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356bb61-7971-4e70-be55-b8c1dd5f0bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:26.553430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356bb61-7971-4e70-be55-b8c1dd5f0bf3 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:26.553712 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356bb61-7971-4e70-be55-b8c1dd5f0bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:26.554014 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356bb61-7971-4e70-be55-b8c1dd5f0bf3 None admin] PATH_INFO: `/v3/groups/d55141dd1f9c4438852b135998c96b6a` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:26.567416 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356bb61-7971-4e70-be55-b8c1dd5f0bf3 None admin] RBAC: Authorizing `identity:get_group(group_id=d55141dd1f9c4438852b135998c96b6a)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:26.569024 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356bb61-7971-4e70-be55-b8c1dd5f0bf3 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:26.571143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 190/379] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Oct 8 20:33:26 2022] GET /identity/v3/groups/d55141dd1f9c4438852b135998c96b6a => generated 229 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:26.577182 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e5c8-b508-4e96-a6a7-0cf269474a24 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:26.715950 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e5c8-b508-4e96-a6a7-0cf269474a24 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:26.752015 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb91b0-542e-450a-930d-14a88233e667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:26.752637 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb91b0-542e-450a-930d-14a88233e667 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:26.752914 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb91b0-542e-450a-930d-14a88233e667 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:26.753186 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb91b0-542e-450a-930d-14a88233e667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:26.754486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb91b0-542e-450a-930d-14a88233e667 None admin] RBAC: Adding query filter params (group.id=d55141dd1f9c4438852b135998c96b6a, role.id=323ca657fe7b4b878fd8328ef78f29f4, scope.project.id=552b2e45ebde4268bba84c6dbc8036cb) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:26.754859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb91b0-542e-450a-930d-14a88233e667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:26.756315 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb91b0-542e-450a-930d-14a88233e667 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:26.764935 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 190/380] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Oct 8 20:33:26 2022] GET /identity/v3/role_assignments?group.id=d55141dd1f9c4438852b135998c96b6a&scope.project.id=552b2e45ebde4268bba84c6dbc8036cb&role.id=323ca657fe7b4b878fd8328ef78f29f4 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:27.333070 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727342d-2733-494c-93e0-587c66fbcd7f None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:27.333259 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727342d-2733-494c-93e0-587c66fbcd7f None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:27.333542 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727342d-2733-494c-93e0-587c66fbcd7f None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:27.335069 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 191/381] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:27.352351 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b5f57-6785-48ca-8ad6-46fb1fcb5c5f None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:27.352949 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b5f57-6785-48ca-8ad6-46fb1fcb5c5f None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:27.353445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b5f57-6785-48ca-8ad6-46fb1fcb5c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:27.367359 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:27.381122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-c26b5f57-6785-48ca-8ad6-46fb1fcb5c5f None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:27.382681 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-c26b5f57-6785-48ca-8ad6-46fb1fcb5c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:27.477396 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 191/382] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:27.619446 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d9943-17b8-46cb-9f7b-359d7315feef None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:27.619931 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d9943-17b8-46cb-9f7b-359d7315feef None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:27.619931 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d9943-17b8-46cb-9f7b-359d7315feef None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:27.621459 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 192/383] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:27.626688 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be00d4-8cd0-4838-96c0-272d7af3fdd0 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:27.627191 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be00d4-8cd0-4838-96c0-272d7af3fdd0 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:27.627681 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be00d4-8cd0-4838-96c0-272d7af3fdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:27.649624 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-66be00d4-8cd0-4838-96c0-272d7af3fdd0 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:27.651174 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-66be00d4-8cd0-4838-96c0-272d7af3fdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:27.737739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 192/384] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:27.892487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d9943-17b8-46cb-9f7b-359d7315feef None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:27.903019 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:28.000411 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d9943-17b8-46cb-9f7b-359d7315feef None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:28.036382 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01be33-15ce-41cf-8472-30f833aa21db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:28.037021 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01be33-15ce-41cf-8472-30f833aa21db None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:28.037304 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01be33-15ce-41cf-8472-30f833aa21db None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:28.037579 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01be33-15ce-41cf-8472-30f833aa21db None admin] PATH_INFO: `/v3/roles/member` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:28.047890 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01be33-15ce-41cf-8472-30f833aa21db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-fc01be33-15ce-41cf-8472-30f833aa21db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:28.061388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:28.062340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:28.063147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:28.063147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:28.063147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:28.063147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:28.063147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:28.063147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:28.063147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:28.063147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:28.063147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:28.063147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:28.063147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:28.063147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:28.063147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 193/385] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:28.069606 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be00d4-8cd0-4838-96c0-272d7af3fdd0 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:28.134604 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:28.192524 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be00d4-8cd0-4838-96c0-272d7af3fdd0 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:28.193564 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01be33-15ce-41cf-8472-30f833aa21db None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:28.284039 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4bea2-8beb-475b-a030-56aaa375f81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:28.285372 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4bea2-8beb-475b-a030-56aaa375f81a None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:28.285765 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4bea2-8beb-475b-a030-56aaa375f81a None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:28.286292 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4bea2-8beb-475b-a030-56aaa375f81a None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:28.287758 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4bea2-8beb-475b-a030-56aaa375f81a None admin] RBAC: Adding query filter params (name=member) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:28.288086 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4bea2-8beb-475b-a030-56aaa375f81a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:28.289571 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4bea2-8beb-475b-a030-56aaa375f81a None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:28.316808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 193/386] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:28.329423 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:28.330346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4bea2-8beb-475b-a030-56aaa375f81a None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:28.407930 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01be33-15ce-41cf-8472-30f833aa21db None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:28.482031 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31786831-07f4-4edd-a2a3-ec6733d5f941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:28.483104 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31786831-07f4-4edd-a2a3-ec6733d5f941 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:28.484562 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31786831-07f4-4edd-a2a3-ec6733d5f941 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:28.485622 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31786831-07f4-4edd-a2a3-ec6733d5f941 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:28.500604 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4bea2-8beb-475b-a030-56aaa375f81a None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:28.507771 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31786831-07f4-4edd-a2a3-ec6733d5f941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-31786831-07f4-4edd-a2a3-ec6733d5f941 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:28.517331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:28.518280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:28.519616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:28.519616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:28.519616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:28.519616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:28.519616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:28.519616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:28.519616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:28.519616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:28.519616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:28.519616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:28.519616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:28.519616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:28.520230 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 194/387] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:33:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:33:28.525439 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31786831-07f4-4edd-a2a3-ec6733d5f941 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:28.555327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:28.575277 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eda8a8-02e5-4229-8c6c-f2a81339cc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:28.576370 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eda8a8-02e5-4229-8c6c-f2a81339cc93 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:28.577470 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eda8a8-02e5-4229-8c6c-f2a81339cc93 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:28.578911 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eda8a8-02e5-4229-8c6c-f2a81339cc93 None admin] PATH_INFO: `/v3/groups/21a98ebc20b4444a8e490b2a087edc4a` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:28.581475 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eda8a8-02e5-4229-8c6c-f2a81339cc93 None admin] RBAC: Authorizing `identity:get_group(group_id=21a98ebc20b4444a8e490b2a087edc4a)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:28.584725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eda8a8-02e5-4229-8c6c-f2a81339cc93 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:28.589815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 194/388] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Oct 8 20:33:28 2022] GET /identity/v3/groups/21a98ebc20b4444a8e490b2a087edc4a => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:28.593156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eda8a8-02e5-4229-8c6c-f2a81339cc93 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:28.752210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31786831-07f4-4edd-a2a3-ec6733d5f941 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:28.760582 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eda8a8-02e5-4229-8c6c-f2a81339cc93 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:28.791934 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:28.808261 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133ec40-5f0e-4e8f-90d1-0f6e1f32dcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:28.809341 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133ec40-5f0e-4e8f-90d1-0f6e1f32dcee None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:28.809626 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133ec40-5f0e-4e8f-90d1-0f6e1f32dcee None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:28.809925 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133ec40-5f0e-4e8f-90d1-0f6e1f32dcee None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:28.810596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133ec40-5f0e-4e8f-90d1-0f6e1f32dcee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:28.810904 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133ec40-5f0e-4e8f-90d1-0f6e1f32dcee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:28.812289 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133ec40-5f0e-4e8f-90d1-0f6e1f32dcee None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:28.814929 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b38f4-2110-4afa-9e98-9ca46116bc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:28.815563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b38f4-2110-4afa-9e98-9ca46116bc97 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:28.815845 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b38f4-2110-4afa-9e98-9ca46116bc97 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:28.816756 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b38f4-2110-4afa-9e98-9ca46116bc97 None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:28.818208 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b38f4-2110-4afa-9e98-9ca46116bc97 None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:28.819783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b38f4-2110-4afa-9e98-9ca46116bc97 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:28.821573 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 195/389] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:28 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:28.831538 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b38f4-2110-4afa-9e98-9ca46116bc97 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:28.835326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 195/390] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:28.843009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133ec40-5f0e-4e8f-90d1-0f6e1f32dcee None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:28.904887 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:28.953471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b38f4-2110-4afa-9e98-9ca46116bc97 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:28.969951 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133ec40-5f0e-4e8f-90d1-0f6e1f32dcee None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:28.996828 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ea041-e577-4af0-99a1-270bef5cc21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:28.998087 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ea041-e577-4af0-99a1-270bef5cc21f None admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:28.998633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ea041-e577-4af0-99a1-270bef5cc21f None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:28.999176 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ea041-e577-4af0-99a1-270bef5cc21f None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228/groups/21a98ebc20b4444a8e490b2a087edc4a/roles/fc58707301804afca34ac8fe194639ed` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:29.001932 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ea041-e577-4af0-99a1-270bef5cc21f None admin] RBAC: Authorizing `identity:create_grant(project_id=eaae93f262bf474db3770d3977f5e228, group_id=21a98ebc20b4444a8e490b2a087edc4a, role_id=fc58707301804afca34ac8fe194639ed)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:29.004766 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ea041-e577-4af0-99a1-270bef5cc21f None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:29.007726 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbb915-df2c-4581-9f96-8aa6da009b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:29.008607 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbb915-df2c-4581-9f96-8aa6da009b32 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:29.009026 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbb915-df2c-4581-9f96-8aa6da009b32 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:29.009443 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbb915-df2c-4581-9f96-8aa6da009b32 None admin] PATH_INFO: `/v3/groups/21a98ebc20b4444a8e490b2a087edc4a` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:29.010918 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbb915-df2c-4581-9f96-8aa6da009b32 None admin] RBAC: Authorizing `identity:get_group(group_id=21a98ebc20b4444a8e490b2a087edc4a)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:29.012473 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbb915-df2c-4581-9f96-8aa6da009b32 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:29.014489 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 196/391] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Oct 8 20:33:28 2022] GET /identity/v3/groups/21a98ebc20b4444a8e490b2a087edc4a => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:29.016035 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0b97-6bc0-4a65-a358-4f09e4eafd81 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:29.016647 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0b97-6bc0-4a65-a358-4f09e4eafd81 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:29.017118 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0b97-6bc0-4a65-a358-4f09e4eafd81 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:29.018786 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 197/392] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:29.020253 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c0b97-6bc0-4a65-a358-4f09e4eafd81 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:29.021486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 196/393] 10.222.0.36 () {58 vars in 1442 bytes} [Sat Oct 8 20:33:28 2022] PUT /identity/v3/projects/eaae93f262bf474db3770d3977f5e228/groups/21a98ebc20b4444a8e490b2a087edc4a/roles/fc58707301804afca34ac8fe194639ed => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:33:29.026131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7662890-c8e4-4281-ac8a-5ee15d30e2de None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:29.026593 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7662890-c8e4-4281-ac8a-5ee15d30e2de None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:29.026934 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7662890-c8e4-4281-ac8a-5ee15d30e2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:29.061917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-f7662890-c8e4-4281-ac8a-5ee15d30e2de None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:29.061917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-f7662890-c8e4-4281-ac8a-5ee15d30e2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:29.134844 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:29.149911 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 197/394] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:33:29.193171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c0b97-6bc0-4a65-a358-4f09e4eafd81 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:29.231747 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c1f5f-85ad-4e0c-be7b-792d0475b98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:29.232826 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c1f5f-85ad-4e0c-be7b-792d0475b98b None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:29.233311 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c1f5f-85ad-4e0c-be7b-792d0475b98b None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:29.234096 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c1f5f-85ad-4e0c-be7b-792d0475b98b None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:29.235588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c1f5f-85ad-4e0c-be7b-792d0475b98b None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:29.237381 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c1f5f-85ad-4e0c-be7b-792d0475b98b None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:29.240698 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 198/395] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:29 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:29.246258 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7662890-c8e4-4281-ac8a-5ee15d30e2de None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:29.307440 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:29.379415 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7662890-c8e4-4281-ac8a-5ee15d30e2de None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:29.420061 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c74cd-8941-4edf-aa22-c1f587ebb5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:29.421095 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c74cd-8941-4edf-aa22-c1f587ebb5de None admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:29.421581 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c74cd-8941-4edf-aa22-c1f587ebb5de None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:29.422125 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c74cd-8941-4edf-aa22-c1f587ebb5de None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228/groups/21a98ebc20b4444a8e490b2a087edc4a/roles/04e5ea25342a4845b0df239f7f2b0705` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:29.424570 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c74cd-8941-4edf-aa22-c1f587ebb5de None admin] RBAC: Authorizing `identity:create_grant(project_id=eaae93f262bf474db3770d3977f5e228, group_id=21a98ebc20b4444a8e490b2a087edc4a, role_id=04e5ea25342a4845b0df239f7f2b0705)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:29.427228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c74cd-8941-4edf-aa22-c1f587ebb5de None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:29.443978 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 198/396] 10.222.0.36 () {58 vars in 1442 bytes} [Sat Oct 8 20:33:29 2022] PUT /identity/v3/projects/eaae93f262bf474db3770d3977f5e228/groups/21a98ebc20b4444a8e490b2a087edc4a/roles/04e5ea25342a4845b0df239f7f2b0705 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:33:29.524509 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c1f5f-85ad-4e0c-be7b-792d0475b98b None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:29.660469 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c1f5f-85ad-4e0c-be7b-792d0475b98b None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:29.689853 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:29.704507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1899ed-ecfb-41d1-9f00-12dd4b043624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:29.705153 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1899ed-ecfb-41d1-9f00-12dd4b043624 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:29.705490 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1899ed-ecfb-41d1-9f00-12dd4b043624 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:29.705778 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1899ed-ecfb-41d1-9f00-12dd4b043624 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:29.721163 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1899ed-ecfb-41d1-9f00-12dd4b043624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-ee1899ed-ecfb-41d1-9f00-12dd4b043624 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:29.727708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:29.728601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:29.729776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:29.729776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:29.729776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:29.729776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:29.729776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:29.729776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:29.729776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:29.729776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:29.729776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:29.729776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:29.729776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:29.729776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:29.729776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 199/397] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:29.734884 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c74cd-8941-4edf-aa22-c1f587ebb5de None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:29.850650 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c74cd-8941-4edf-aa22-c1f587ebb5de None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:29.872971 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:29.898932 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487eb39-f362-4d92-b1c5-6789795b19c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:29.899599 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487eb39-f362-4d92-b1c5-6789795b19c0 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:29.899878 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487eb39-f362-4d92-b1c5-6789795b19c0 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:29.900181 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487eb39-f362-4d92-b1c5-6789795b19c0 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:29.900853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487eb39-f362-4d92-b1c5-6789795b19c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:29.901153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487eb39-f362-4d92-b1c5-6789795b19c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:29.902528 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487eb39-f362-4d92-b1c5-6789795b19c0 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:29.909202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb1e8f-0288-4a7e-b9e8-7d5b2139187a None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:29.909844 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb1e8f-0288-4a7e-b9e8-7d5b2139187a None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:29.909844 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb1e8f-0288-4a7e-b9e8-7d5b2139187a None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:29.912098 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 200/398] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:29.915210 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 199/399] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:29.919774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6117a-f9e5-457e-a70b-1ac09f721885 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:29.920024 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6117a-f9e5-457e-a70b-1ac09f721885 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:29.920288 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6117a-f9e5-457e-a70b-1ac09f721885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:29.924287 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487eb39-f362-4d92-b1c5-6789795b19c0 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:29.952942 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-0cb6117a-f9e5-457e-a70b-1ac09f721885 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:29.954169 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-0cb6117a-f9e5-457e-a70b-1ac09f721885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:30.029567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 201/400] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:30.031259 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a3338-c785-484e-8852-e6bf0140c1f6 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:30.031742 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a3338-c785-484e-8852-e6bf0140c1f6 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:30.032210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a3338-c785-484e-8852-e6bf0140c1f6 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:30.033907 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 202/401] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:30.043316 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c52c8-beaa-4139-a24f-5ce54167010f None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:30.044066 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c52c8-beaa-4139-a24f-5ce54167010f None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:30.044534 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c52c8-beaa-4139-a24f-5ce54167010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:30.085910 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487eb39-f362-4d92-b1c5-6789795b19c0 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:30.099036 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-bd2c52c8-beaa-4139-a24f-5ce54167010f None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:30.100157 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-bd2c52c8-beaa-4139-a24f-5ce54167010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:30.126177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b172dd-cc40-49ef-8b92-8975a48dcf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:30.127218 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b172dd-cc40-49ef-8b92-8975a48dcf85 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:30.127653 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b172dd-cc40-49ef-8b92-8975a48dcf85 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:30.128104 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b172dd-cc40-49ef-8b92-8975a48dcf85 None admin] PATH_INFO: `/v3/groups/21a98ebc20b4444a8e490b2a087edc4a` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:30.129669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b172dd-cc40-49ef-8b92-8975a48dcf85 None admin] RBAC: Authorizing `identity:get_group(group_id=21a98ebc20b4444a8e490b2a087edc4a)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:30.131847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b172dd-cc40-49ef-8b92-8975a48dcf85 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:30.133896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 200/402] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Oct 8 20:33:29 2022] GET /identity/v3/groups/21a98ebc20b4444a8e490b2a087edc4a => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:30.139616 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b172dd-cc40-49ef-8b92-8975a48dcf85 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:30.194400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:30.243500 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 203/403] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:33:30.271088 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b172dd-cc40-49ef-8b92-8975a48dcf85 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:30.320683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc00929-5445-4f83-aa85-cd17004579c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:30.321559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc00929-5445-4f83-aa85-cd17004579c7 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:30.322014 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc00929-5445-4f83-aa85-cd17004579c7 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:30.322468 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc00929-5445-4f83-aa85-cd17004579c7 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:30.326549 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc00929-5445-4f83-aa85-cd17004579c7 None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:30.328228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc00929-5445-4f83-aa85-cd17004579c7 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:30.330305 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 201/404] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:30 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:30.336529 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c52c8-beaa-4139-a24f-5ce54167010f None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:30.397835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:30.455120 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c52c8-beaa-4139-a24f-5ce54167010f None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:30.490519 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182d701-ebe4-4fa9-ad20-50c305113670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:30.491183 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182d701-ebe4-4fa9-ad20-50c305113670 None admin] REQUEST_METHOD: `PUT` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:30.491457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182d701-ebe4-4fa9-ad20-50c305113670 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:30.491724 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182d701-ebe4-4fa9-ad20-50c305113670 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f/groups/21a98ebc20b4444a8e490b2a087edc4a/roles/fc58707301804afca34ac8fe194639ed` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:30.493614 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182d701-ebe4-4fa9-ad20-50c305113670 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a98056efe76460d9e79ef3963745a2f, group_id=21a98ebc20b4444a8e490b2a087edc4a, role_id=fc58707301804afca34ac8fe194639ed)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:30.495073 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182d701-ebe4-4fa9-ad20-50c305113670 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:30.509924 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 204/405] 10.222.0.36 () {58 vars in 1442 bytes} [Sat Oct 8 20:33:30 2022] PUT /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f/groups/21a98ebc20b4444a8e490b2a087edc4a/roles/fc58707301804afca34ac8fe194639ed => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:33:30.540068 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc00929-5445-4f83-aa85-cd17004579c7 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:30.666625 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc00929-5445-4f83-aa85-cd17004579c7 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:30.679666 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:30.707010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03805d-03a7-4156-80a3-73093ccbad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:30.708250 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03805d-03a7-4156-80a3-73093ccbad6b None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:30.708686 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03805d-03a7-4156-80a3-73093ccbad6b None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:30.709129 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03805d-03a7-4156-80a3-73093ccbad6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:30.720641 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03805d-03a7-4156-80a3-73093ccbad6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-6f03805d-03a7-4156-80a3-73093ccbad6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:30.726898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:30.728042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:30.729065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:30.729065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:30.729065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:30.729065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:30.729065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:30.729065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:30.729065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:30.729065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:30.729065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:30.729065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:30.729065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:33:30.729065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:30.729830 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182d701-ebe4-4fa9-ad20-50c305113670 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:30.731535 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 202/406] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:33:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:30.739344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03805d-03a7-4156-80a3-73093ccbad6b None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:30.910484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182d701-ebe4-4fa9-ad20-50c305113670 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:30.913660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:30.914712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03805d-03a7-4156-80a3-73093ccbad6b None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:30.953912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dae93-a21e-4a9d-89b2-71e90bcc41f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:30.953912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dae93-a21e-4a9d-89b2-71e90bcc41f5 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:30.953912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dae93-a21e-4a9d-89b2-71e90bcc41f5 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:30.953912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dae93-a21e-4a9d-89b2-71e90bcc41f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:30.961210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dae93-a21e-4a9d-89b2-71e90bcc41f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:30.963112 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4f8cb-1451-4ebc-9b6d-8a978c51f139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:30.963987 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4f8cb-1451-4ebc-9b6d-8a978c51f139 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:30.964530 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4f8cb-1451-4ebc-9b6d-8a978c51f139 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:30.965020 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4f8cb-1451-4ebc-9b6d-8a978c51f139 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:30.965915 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4f8cb-1451-4ebc-9b6d-8a978c51f139 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-4b3dae93-a21e-4a9d-89b2-71e90bcc41f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:30.966239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:30.967119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:30.967939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:30.967939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:30.967939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:30.967939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:30.967939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:30.967939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:30.967939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:30.967939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:30.967939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:30.967939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:30.967939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:30.967939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:30.969245 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4f8cb-1451-4ebc-9b6d-8a978c51f139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:30.970899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4f8cb-1451-4ebc-9b6d-8a978c51f139 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:30.971021 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 205/407] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:33:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:30.977908 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dae93-a21e-4a9d-89b2-71e90bcc41f5 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:30.986550 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 203/408] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:31.000324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4f8cb-1451-4ebc-9b6d-8a978c51f139 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:31.068819 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:31.124332 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dae93-a21e-4a9d-89b2-71e90bcc41f5 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:31.196253 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e895f77-4fa6-4a5e-968c-ffdb88c299e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:31.197581 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e895f77-4fa6-4a5e-968c-ffdb88c299e0 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:31.198476 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e895f77-4fa6-4a5e-968c-ffdb88c299e0 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:31.199901 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e895f77-4fa6-4a5e-968c-ffdb88c299e0 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:31.200774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e895f77-4fa6-4a5e-968c-ffdb88c299e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:31.201940 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e895f77-4fa6-4a5e-968c-ffdb88c299e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:31.204187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4f8cb-1451-4ebc-9b6d-8a978c51f139 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:31.205793 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e895f77-4fa6-4a5e-968c-ffdb88c299e0 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:31.225699 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 206/409] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:31.231415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e895f77-4fa6-4a5e-968c-ffdb88c299e0 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:31.272043 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:31.275591 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743572dd-ec33-4bec-a6e7-2749714f2a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:31.276697 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743572dd-ec33-4bec-a6e7-2749714f2a70 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:31.276996 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743572dd-ec33-4bec-a6e7-2749714f2a70 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:31.277277 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743572dd-ec33-4bec-a6e7-2749714f2a70 None admin] PATH_INFO: `/v3/groups/d55141dd1f9c4438852b135998c96b6a` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:31.282576 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743572dd-ec33-4bec-a6e7-2749714f2a70 None admin] RBAC: Authorizing `identity:get_group(group_id=d55141dd1f9c4438852b135998c96b6a)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:31.286774 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743572dd-ec33-4bec-a6e7-2749714f2a70 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:31.291568 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 204/410] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Oct 8 20:33:30 2022] GET /identity/v3/groups/d55141dd1f9c4438852b135998c96b6a => generated 229 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:31.302879 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743572dd-ec33-4bec-a6e7-2749714f2a70 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:31.356751 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e895f77-4fa6-4a5e-968c-ffdb88c299e0 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:31.400060 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac0c59-6efa-47b3-810b-36e60841b02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:31.400959 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac0c59-6efa-47b3-810b-36e60841b02f None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:31.401233 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac0c59-6efa-47b3-810b-36e60841b02f None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:31.401504 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac0c59-6efa-47b3-810b-36e60841b02f None admin] PATH_INFO: `/v3/groups/21a98ebc20b4444a8e490b2a087edc4a` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:31.403518 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac0c59-6efa-47b3-810b-36e60841b02f None admin] RBAC: Authorizing `identity:get_group(group_id=21a98ebc20b4444a8e490b2a087edc4a)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:31.407699 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac0c59-6efa-47b3-810b-36e60841b02f None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:31.417610 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 207/411] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Oct 8 20:33:31 2022] GET /identity/v3/groups/21a98ebc20b4444a8e490b2a087edc4a => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:31.418616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac0c59-6efa-47b3-810b-36e60841b02f None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:31.498764 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:31.503273 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743572dd-ec33-4bec-a6e7-2749714f2a70 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:31.579384 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03579392-bc33-402d-82a0-59c549d7437f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:31.580017 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03579392-bc33-402d-82a0-59c549d7437f None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:31.580338 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03579392-bc33-402d-82a0-59c549d7437f None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:31.580612 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03579392-bc33-402d-82a0-59c549d7437f None admin] PATH_INFO: `/v3/projects/552b2e45ebde4268bba84c6dbc8036cb` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:31.582738 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03579392-bc33-402d-82a0-59c549d7437f None admin] RBAC: Authorizing `identity:get_project(project_id=552b2e45ebde4268bba84c6dbc8036cb)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:31.584165 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03579392-bc33-402d-82a0-59c549d7437f None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:31.594066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 205/412] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:31 2022] GET /identity/v3/projects/552b2e45ebde4268bba84c6dbc8036cb => generated 344 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:31.602430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac0c59-6efa-47b3-810b-36e60841b02f None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:31.610207 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03579392-bc33-402d-82a0-59c549d7437f None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:31.622275 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:31.664732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e6a9e-14f5-4ee8-bbc5-c686a115edf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:31.665379 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e6a9e-14f5-4ee8-bbc5-c686a115edf2 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:31.665649 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e6a9e-14f5-4ee8-bbc5-c686a115edf2 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:31.666029 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e6a9e-14f5-4ee8-bbc5-c686a115edf2 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:31.667246 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e6a9e-14f5-4ee8-bbc5-c686a115edf2 None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:31.668720 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e6a9e-14f5-4ee8-bbc5-c686a115edf2 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:31.676295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 208/413] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:31 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:31.677584 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e6a9e-14f5-4ee8-bbc5-c686a115edf2 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:31.784139 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e6a9e-14f5-4ee8-bbc5-c686a115edf2 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:31.813326 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03579392-bc33-402d-82a0-59c549d7437f None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:31.820306 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a90d4-c51b-44c7-ae00-8ab22f0487c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:31.820973 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a90d4-c51b-44c7-ae00-8ab22f0487c8 None admin] REQUEST_METHOD: `PUT` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:31.821249 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a90d4-c51b-44c7-ae00-8ab22f0487c8 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:31.821520 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a90d4-c51b-44c7-ae00-8ab22f0487c8 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f/groups/21a98ebc20b4444a8e490b2a087edc4a/roles/04e5ea25342a4845b0df239f7f2b0705` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:31.823680 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a90d4-c51b-44c7-ae00-8ab22f0487c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a98056efe76460d9e79ef3963745a2f, group_id=21a98ebc20b4444a8e490b2a087edc4a, role_id=04e5ea25342a4845b0df239f7f2b0705)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:31.825304 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a90d4-c51b-44c7-ae00-8ab22f0487c8 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:31.849693 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 209/414] 10.222.0.36 () {58 vars in 1442 bytes} [Sat Oct 8 20:33:31 2022] PUT /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f/groups/21a98ebc20b4444a8e490b2a087edc4a/roles/04e5ea25342a4845b0df239f7f2b0705 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:33:31.877253 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f56b93-390f-4f86-b816-3019493adcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:31.877995 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f56b93-390f-4f86-b816-3019493adcff None admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:31.878999 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f56b93-390f-4f86-b816-3019493adcff None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:31.879370 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f56b93-390f-4f86-b816-3019493adcff None admin] PATH_INFO: `/v3/projects/552b2e45ebde4268bba84c6dbc8036cb/groups/d55141dd1f9c4438852b135998c96b6a/roles/323ca657fe7b4b878fd8328ef78f29f4` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:31.881292 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f56b93-390f-4f86-b816-3019493adcff None admin] RBAC: Authorizing `identity:create_grant(project_id=552b2e45ebde4268bba84c6dbc8036cb, group_id=d55141dd1f9c4438852b135998c96b6a, role_id=323ca657fe7b4b878fd8328ef78f29f4)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:31.882887 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f56b93-390f-4f86-b816-3019493adcff None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:31.906349 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 206/415] 10.222.0.36 () {58 vars in 1442 bytes} [Sat Oct 8 20:33:31 2022] PUT /identity/v3/projects/552b2e45ebde4268bba84c6dbc8036cb/groups/d55141dd1f9c4438852b135998c96b6a/roles/323ca657fe7b4b878fd8328ef78f29f4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:33:32.054483 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1b5bd-de60-4391-b44c-2fdf460f8e43 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:32.054962 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1b5bd-de60-4391-b44c-2fdf460f8e43 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:32.054962 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1b5bd-de60-4391-b44c-2fdf460f8e43 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:32.056885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 210/416] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:32.066354 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae438d3b-81b7-4e7a-93be-be1534326e29 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:32.066354 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae438d3b-81b7-4e7a-93be-be1534326e29 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:32.066354 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae438d3b-81b7-4e7a-93be-be1534326e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:32.083886 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-ae438d3b-81b7-4e7a-93be-be1534326e29 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:32.085168 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-ae438d3b-81b7-4e7a-93be-be1534326e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:32.122590 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:32.189455 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 207/417] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:32.202553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae3f45-d002-437f-8bb1-9a1c213001c5 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:32.202856 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae3f45-d002-437f-8bb1-9a1c213001c5 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:32.203109 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae3f45-d002-437f-8bb1-9a1c213001c5 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:32.204718 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 211/418] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:32.211494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb13e-f3a3-4de8-8a06-4358a0cbb478 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:32.211795 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb13e-f3a3-4de8-8a06-4358a0cbb478 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:32.212042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb13e-f3a3-4de8-8a06-4358a0cbb478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:32.231925 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-2cabb13e-f3a3-4de8-8a06-4358a0cbb478 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:32.233204 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-2cabb13e-f3a3-4de8-8a06-4358a0cbb478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:32.311095 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 208/419] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:32.553553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae3f45-d002-437f-8bb1-9a1c213001c5 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:32.581090 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:32.699498 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae3f45-d002-437f-8bb1-9a1c213001c5 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:32.740465 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b3672-d09e-49b6-9e1e-6b519506955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:32.741097 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b3672-d09e-49b6-9e1e-6b519506955b None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:32.741372 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b3672-d09e-49b6-9e1e-6b519506955b None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:32.741645 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b3672-d09e-49b6-9e1e-6b519506955b None admin] PATH_INFO: `/v3/roles/member` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:32.754400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabb13e-f3a3-4de8-8a06-4358a0cbb478 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:32.755423 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b3672-d09e-49b6-9e1e-6b519506955b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-823b3672-d09e-49b6-9e1e-6b519506955b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:32.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:32.761116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:32.761980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:32.761980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:32.761980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:32.761980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:32.761980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:32.761980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:32.761980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:32.761980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:32.761980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:32.761980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:32.761980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:32.761980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:32.761980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 212/420] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:32.767777 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b3672-d09e-49b6-9e1e-6b519506955b None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:32.918351 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:32.932154 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:32.937548 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b3672-d09e-49b6-9e1e-6b519506955b None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:32.953158 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabb13e-f3a3-4de8-8a06-4358a0cbb478 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:32.985189 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baadab-c31b-4a6e-8d18-3a48c42783e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:32.985802 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baadab-c31b-4a6e-8d18-3a48c42783e3 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:32.986180 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baadab-c31b-4a6e-8d18-3a48c42783e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:32.986450 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baadab-c31b-4a6e-8d18-3a48c42783e3 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:32.987106 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baadab-c31b-4a6e-8d18-3a48c42783e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:32.987407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baadab-c31b-4a6e-8d18-3a48c42783e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:32.988964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baadab-c31b-4a6e-8d18-3a48c42783e3 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:33.002436 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 213/421] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:33.004022 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baadab-c31b-4a6e-8d18-3a48c42783e3 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:33.018461 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744335e-8504-404d-af13-e6a867ba985c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:33.019619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744335e-8504-404d-af13-e6a867ba985c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:33.019904 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744335e-8504-404d-af13-e6a867ba985c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:33.026272 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744335e-8504-404d-af13-e6a867ba985c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:33.054528 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744335e-8504-404d-af13-e6a867ba985c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-7744335e-8504-404d-af13-e6a867ba985c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:33.060054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:33.060919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:33.061718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:33.061718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:33.061718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:33.061718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:33.061718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:33.061718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:33.061718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:33.061718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:33.061718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:33.061718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:33.061718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:33.061718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:33.061718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 209/422] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:33:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:33.069117 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744335e-8504-404d-af13-e6a867ba985c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:33.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baadab-c31b-4a6e-8d18-3a48c42783e3 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:33.146826 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28053230-c6f5-4abd-a48c-505afed80432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:33.147674 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28053230-c6f5-4abd-a48c-505afed80432 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:33.147951 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28053230-c6f5-4abd-a48c-505afed80432 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:33.148221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28053230-c6f5-4abd-a48c-505afed80432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:33.178380 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:33.282814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28053230-c6f5-4abd-a48c-505afed80432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:33.285768 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28053230-c6f5-4abd-a48c-505afed80432 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:33.302156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744335e-8504-404d-af13-e6a867ba985c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:33.395777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46166134-26f2-43cc-a7cc-883faf13ec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:33.396386 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46166134-26f2-43cc-a7cc-883faf13ec86 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:33.396667 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46166134-26f2-43cc-a7cc-883faf13ec86 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:33.396937 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46166134-26f2-43cc-a7cc-883faf13ec86 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:33.403659 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 214/423] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:33:33.404269 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46166134-26f2-43cc-a7cc-883faf13ec86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:33.404644 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46166134-26f2-43cc-a7cc-883faf13ec86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:33.406060 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46166134-26f2-43cc-a7cc-883faf13ec86 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:33.410659 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28053230-c6f5-4abd-a48c-505afed80432 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:33.427598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 210/424] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:33.435039 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46166134-26f2-43cc-a7cc-883faf13ec86 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:33.457292 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:33.470291 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:33.523535 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28053230-c6f5-4abd-a48c-505afed80432 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:33.558751 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d73a57-f670-467e-b5fc-74c7823e78fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:33.559544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d73a57-f670-467e-b5fc-74c7823e78fe None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:33.559826 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d73a57-f670-467e-b5fc-74c7823e78fe None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:33.560100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d73a57-f670-467e-b5fc-74c7823e78fe None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:33.561216 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d73a57-f670-467e-b5fc-74c7823e78fe None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:33.563239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d73a57-f670-467e-b5fc-74c7823e78fe None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:33.565200 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 215/425] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:33 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:33.571475 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d73a57-f670-467e-b5fc-74c7823e78fe None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:33.679961 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d73a57-f670-467e-b5fc-74c7823e78fe None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:33.698284 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:33.707320 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46166134-26f2-43cc-a7cc-883faf13ec86 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:33.717064 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c862e-b636-4c80-b677-387c5bb5f476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:33.717695 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c862e-b636-4c80-b677-387c5bb5f476 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:33.718020 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c862e-b636-4c80-b677-387c5bb5f476 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:33.718292 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c862e-b636-4c80-b677-387c5bb5f476 None admin] PATH_INFO: `/v3/groups/21a98ebc20b4444a8e490b2a087edc4a` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:33.719404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c862e-b636-4c80-b677-387c5bb5f476 None admin] RBAC: Authorizing `identity:get_group(group_id=21a98ebc20b4444a8e490b2a087edc4a)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:33.721327 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c862e-b636-4c80-b677-387c5bb5f476 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:33.724004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 216/426] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Oct 8 20:33:33 2022] GET /identity/v3/groups/21a98ebc20b4444a8e490b2a087edc4a => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:33.729600 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c862e-b636-4c80-b677-387c5bb5f476 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:33.810591 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43d44a-0f03-4ce2-a234-82a0ab0e1255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:33.811218 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43d44a-0f03-4ce2-a234-82a0ab0e1255 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:33.811499 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43d44a-0f03-4ce2-a234-82a0ab0e1255 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:33.811768 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43d44a-0f03-4ce2-a234-82a0ab0e1255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:33.832641 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c862e-b636-4c80-b677-387c5bb5f476 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:33.866907 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982f498-7291-4727-b142-5345c3ecd57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:33.867416 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982f498-7291-4727-b142-5345c3ecd57c None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:33.867695 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982f498-7291-4727-b142-5345c3ecd57c None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:33.867954 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982f498-7291-4727-b142-5345c3ecd57c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:33.868665 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982f498-7291-4727-b142-5345c3ecd57c None admin] RBAC: Adding query filter params (group.id=21a98ebc20b4444a8e490b2a087edc4a, role.id=fc58707301804afca34ac8fe194639ed, scope.project.id=eaae93f262bf474db3770d3977f5e228) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:33.868970 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982f498-7291-4727-b142-5345c3ecd57c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:33.870465 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982f498-7291-4727-b142-5345c3ecd57c None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:33.876544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 217/427] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Oct 8 20:33:33 2022] GET /identity/v3/role_assignments?group.id=21a98ebc20b4444a8e490b2a087edc4a&scope.project.id=eaae93f262bf474db3770d3977f5e228&role.id=fc58707301804afca34ac8fe194639ed => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:33.967505 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43d44a-0f03-4ce2-a234-82a0ab0e1255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:33.968889 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43d44a-0f03-4ce2-a234-82a0ab0e1255 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:33.985163 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:33.992333 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1af03-8d64-4900-b8ec-2b64d0260048 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:33.992672 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1af03-8d64-4900-b8ec-2b64d0260048 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:33.992885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1af03-8d64-4900-b8ec-2b64d0260048 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:33.995900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 218/428] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:33:34.001686 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca22788-aff5-4c6d-8870-626b937bdf45 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:34.001998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca22788-aff5-4c6d-8870-626b937bdf45 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:34.002271 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca22788-aff5-4c6d-8870-626b937bdf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:34.025914 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-aca22788-aff5-4c6d-8870-626b937bdf45 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:34.026138 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-aca22788-aff5-4c6d-8870-626b937bdf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:34.114485 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:34.150731 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 211/429] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:34.154874 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 219/430] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:34.156759 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43d44a-0f03-4ce2-a234-82a0ab0e1255 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:34.299457 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43d44a-0f03-4ce2-a234-82a0ab0e1255 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:34.313283 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:34.341770 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da549f-ef38-4b1a-a0c4-f3e78f70222c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:34.342497 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da549f-ef38-4b1a-a0c4-f3e78f70222c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:34.342782 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da549f-ef38-4b1a-a0c4-f3e78f70222c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:34.343051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da549f-ef38-4b1a-a0c4-f3e78f70222c None admin] PATH_INFO: `/v3/projects/eaae93f262bf474db3770d3977f5e228` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:34.344202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da549f-ef38-4b1a-a0c4-f3e78f70222c None admin] RBAC: Authorizing `identity:get_project(project_id=eaae93f262bf474db3770d3977f5e228)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:34.345618 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da549f-ef38-4b1a-a0c4-f3e78f70222c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:34.347770 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 212/431] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:34 2022] GET /identity/v3/projects/eaae93f262bf474db3770d3977f5e228 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:34.353336 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca22788-aff5-4c6d-8870-626b937bdf45 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:34.462717 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca22788-aff5-4c6d-8870-626b937bdf45 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:34.501700 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12f7ae-622e-4e4d-b229-25cde959d301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:34.502385 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12f7ae-622e-4e4d-b229-25cde959d301 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:34.502660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12f7ae-622e-4e4d-b229-25cde959d301 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:34.502931 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12f7ae-622e-4e4d-b229-25cde959d301 None admin] PATH_INFO: `/v3/groups/21a98ebc20b4444a8e490b2a087edc4a` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:34.504544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12f7ae-622e-4e4d-b229-25cde959d301 None admin] RBAC: Authorizing `identity:get_group(group_id=21a98ebc20b4444a8e490b2a087edc4a)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:34.506026 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12f7ae-622e-4e4d-b229-25cde959d301 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:34.507970 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 220/432] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Oct 8 20:33:34 2022] GET /identity/v3/groups/21a98ebc20b4444a8e490b2a087edc4a => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:34.513408 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da549f-ef38-4b1a-a0c4-f3e78f70222c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:34.521968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12f7ae-622e-4e4d-b229-25cde959d301 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:34.579746 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:34.646119 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da549f-ef38-4b1a-a0c4-f3e78f70222c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:34.654131 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12f7ae-622e-4e4d-b229-25cde959d301 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:34.691716 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47ae14-54c9-43e5-aa68-5b5c500656de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:34.692648 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47ae14-54c9-43e5-aa68-5b5c500656de None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:34.693064 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47ae14-54c9-43e5-aa68-5b5c500656de None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:34.693468 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47ae14-54c9-43e5-aa68-5b5c500656de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:34.694330 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47ae14-54c9-43e5-aa68-5b5c500656de None admin] RBAC: Adding query filter params (group.id=21a98ebc20b4444a8e490b2a087edc4a, role.id=04e5ea25342a4845b0df239f7f2b0705, scope.project.id=eaae93f262bf474db3770d3977f5e228) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:34.694730 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47ae14-54c9-43e5-aa68-5b5c500656de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:34.696401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47ae14-54c9-43e5-aa68-5b5c500656de None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:34.696990 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2fba4-5cc6-47c9-8be7-3cba05004c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:34.698486 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2fba4-5cc6-47c9-8be7-3cba05004c0f None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:34.698766 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2fba4-5cc6-47c9-8be7-3cba05004c0f None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:34.699143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2fba4-5cc6-47c9-8be7-3cba05004c0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:34.704388 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 213/433] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Oct 8 20:33:34 2022] GET /identity/v3/role_assignments?group.id=21a98ebc20b4444a8e490b2a087edc4a&scope.project.id=eaae93f262bf474db3770d3977f5e228&role.id=04e5ea25342a4845b0df239f7f2b0705 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:34.714488 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2fba4-5cc6-47c9-8be7-3cba05004c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-1cc2fba4-5cc6-47c9-8be7-3cba05004c0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:34.721363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:34.723092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:34.724039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:34.724039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:34.724039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:34.724039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:34.724039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:34.724039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:34.724039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:34.724039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:34.724039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:34.724039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:34.724039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 08 20:33:34.724039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:34.724039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 221/434] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:34.728108 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa935f-2f39-49cd-8c03-48db4cb1d95f None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:34.728273 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2fba4-5cc6-47c9-8be7-3cba05004c0f None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:34.728704 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa935f-2f39-49cd-8c03-48db4cb1d95f None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:34.729077 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa935f-2f39-49cd-8c03-48db4cb1d95f None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:34.731064 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 214/435] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:34.736930 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbae98-9166-4a5e-846e-715b7a1e4ba9 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:34.737369 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbae98-9166-4a5e-846e-715b7a1e4ba9 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:34.737819 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbae98-9166-4a5e-846e-715b7a1e4ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:34.758721 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-f2cbae98-9166-4a5e-846e-715b7a1e4ba9 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:34.760087 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-f2cbae98-9166-4a5e-846e-715b7a1e4ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:34.813011 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:34.847708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2fba4-5cc6-47c9-8be7-3cba05004c0f None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:34.849380 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:34.878478 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 215/436] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:34.900992 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89580a40-11cd-4cbb-9cfd-a41b4ff5519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:34.902031 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89580a40-11cd-4cbb-9cfd-a41b4ff5519d None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:34.902537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89580a40-11cd-4cbb-9cfd-a41b4ff5519d None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:34.903005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89580a40-11cd-4cbb-9cfd-a41b4ff5519d None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:34.903896 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89580a40-11cd-4cbb-9cfd-a41b4ff5519d None admin] RBAC: Adding query filter params (name=member) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:34.904826 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89580a40-11cd-4cbb-9cfd-a41b4ff5519d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:34.906673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89580a40-11cd-4cbb-9cfd-a41b4ff5519d None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:34.917409 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 222/437] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:33:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:34.923396 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbae98-9166-4a5e-846e-715b7a1e4ba9 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:35.018341 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2238d-5b84-4306-b094-ad1ecd38e850 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:35.018678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2238d-5b84-4306-b094-ad1ecd38e850 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:35.019574 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2238d-5b84-4306-b094-ad1ecd38e850 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:35.021055 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 223/438] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:35.028397 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014b378-96cc-4453-9c0a-e373123931aa None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:35.029065 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014b378-96cc-4453-9c0a-e373123931aa None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:35.029410 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014b378-96cc-4453-9c0a-e373123931aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:35.042367 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbae98-9166-4a5e-846e-715b7a1e4ba9 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:35.051770 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-5014b378-96cc-4453-9c0a-e373123931aa None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:35.052974 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-5014b378-96cc-4453-9c0a-e373123931aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:35.094011 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042e4ce-7770-4d40-849a-da0da95f8f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:35.094919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042e4ce-7770-4d40-849a-da0da95f8f25 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:35.095367 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042e4ce-7770-4d40-849a-da0da95f8f25 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:35.095783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042e4ce-7770-4d40-849a-da0da95f8f25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:35.137946 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 224/439] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:33:35.151093 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:35.185424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042e4ce-7770-4d40-849a-da0da95f8f25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:35.186931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042e4ce-7770-4d40-849a-da0da95f8f25 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:35.237495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014b378-96cc-4453-9c0a-e373123931aa None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:35.302462 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 216/440] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:35.308396 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042e4ce-7770-4d40-849a-da0da95f8f25 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:35.354297 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:35.364081 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014b378-96cc-4453-9c0a-e373123931aa None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:35.386836 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:35.399214 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012b6d3-201a-4db6-b729-3d8a6e0895d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:35.399774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012b6d3-201a-4db6-b729-3d8a6e0895d9 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:35.400053 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012b6d3-201a-4db6-b729-3d8a6e0895d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:35.400324 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012b6d3-201a-4db6-b729-3d8a6e0895d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:35.412899 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012b6d3-201a-4db6-b729-3d8a6e0895d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-3012b6d3-201a-4db6-b729-3d8a6e0895d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:35.418299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:35.419171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:35.419989 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:35.419989 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:35.419989 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:35.419989 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:35.419989 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:35.419989 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:35.419989 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:35.419989 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:35.419989 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:35.419989 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:35.419989 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:33:35.419989 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:35.421167 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042e4ce-7770-4d40-849a-da0da95f8f25 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:35.424351 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 225/441] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:33:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:33:35.424946 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012b6d3-201a-4db6-b729-3d8a6e0895d9 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:35.458122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b145d-9663-4dd1-87ef-c06953cdf765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:35.458745 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b145d-9663-4dd1-87ef-c06953cdf765 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:35.459023 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b145d-9663-4dd1-87ef-c06953cdf765 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:35.459376 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b145d-9663-4dd1-87ef-c06953cdf765 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:35.460419 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b145d-9663-4dd1-87ef-c06953cdf765 None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:35.461860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b145d-9663-4dd1-87ef-c06953cdf765 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:35.463485 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 217/442] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:35 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:35.468788 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b145d-9663-4dd1-87ef-c06953cdf765 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:35.526952 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012b6d3-201a-4db6-b729-3d8a6e0895d9 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:35.562326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98174312-c5a8-4b12-b768-6875bdb9a80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:35.562924 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98174312-c5a8-4b12-b768-6875bdb9a80d None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:35.563197 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98174312-c5a8-4b12-b768-6875bdb9a80d None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:35.563464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98174312-c5a8-4b12-b768-6875bdb9a80d None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:35.564108 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98174312-c5a8-4b12-b768-6875bdb9a80d None admin] RBAC: Adding query filter params (name=admin) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:35.564410 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98174312-c5a8-4b12-b768-6875bdb9a80d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:35.565802 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98174312-c5a8-4b12-b768-6875bdb9a80d None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:35.567168 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b145d-9663-4dd1-87ef-c06953cdf765 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:35.573638 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 226/443] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:35.574457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98174312-c5a8-4b12-b768-6875bdb9a80d None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:35.591585 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:35.601493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b489e21-d0d5-475a-8114-69dcb7eaa598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:35.602154 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b489e21-d0d5-475a-8114-69dcb7eaa598 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:35.602433 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b489e21-d0d5-475a-8114-69dcb7eaa598 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:35.602707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b489e21-d0d5-475a-8114-69dcb7eaa598 None admin] PATH_INFO: `/v3/groups/21a98ebc20b4444a8e490b2a087edc4a` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:35.603811 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b489e21-d0d5-475a-8114-69dcb7eaa598 None admin] RBAC: Authorizing `identity:get_group(group_id=21a98ebc20b4444a8e490b2a087edc4a)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:35.605245 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b489e21-d0d5-475a-8114-69dcb7eaa598 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:35.606824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 218/444] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Oct 8 20:33:35 2022] GET /identity/v3/groups/21a98ebc20b4444a8e490b2a087edc4a => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:35.607577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b489e21-d0d5-475a-8114-69dcb7eaa598 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:35.618668 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:35.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98174312-c5a8-4b12-b768-6875bdb9a80d None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:35.710468 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72522452-aadd-4f58-983f-99393bd92e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:35.710738 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b489e21-d0d5-475a-8114-69dcb7eaa598 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:35.711092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72522452-aadd-4f58-983f-99393bd92e20 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:35.711371 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72522452-aadd-4f58-983f-99393bd92e20 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:35.711643 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72522452-aadd-4f58-983f-99393bd92e20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:35.721550 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72522452-aadd-4f58-983f-99393bd92e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-72522452-aadd-4f58-983f-99393bd92e20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:35.728119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:35.728995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:35.729793 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:35.729793 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:35.729793 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:35.729793 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:35.729793 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:35.729793 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:35.729793 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:35.729793 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:35.729793 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:35.729793 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:35.729793 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 08 20:33:35.729793 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:35.729793 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 227/445] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:33:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:35.730493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72522452-aadd-4f58-983f-99393bd92e20 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:35.747332 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044195ed-0271-44dc-bb71-940bb992711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:35.747941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044195ed-0271-44dc-bb71-940bb992711b None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:35.748218 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044195ed-0271-44dc-bb71-940bb992711b None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:35.748487 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044195ed-0271-44dc-bb71-940bb992711b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:35.816697 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:35.829045 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044195ed-0271-44dc-bb71-940bb992711b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:35.830641 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044195ed-0271-44dc-bb71-940bb992711b None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:35.842179 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72522452-aadd-4f58-983f-99393bd92e20 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:35.842545 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:35.883674 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c9cc9-53bd-436d-9ad0-7bf4f84cdb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:35.884289 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c9cc9-53bd-436d-9ad0-7bf4f84cdb1d None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:35.884570 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c9cc9-53bd-436d-9ad0-7bf4f84cdb1d None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:35.884848 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c9cc9-53bd-436d-9ad0-7bf4f84cdb1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:35.885580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c9cc9-53bd-436d-9ad0-7bf4f84cdb1d None admin] RBAC: Adding query filter params (group.id=21a98ebc20b4444a8e490b2a087edc4a, role.id=fc58707301804afca34ac8fe194639ed, scope.project.id=8a98056efe76460d9e79ef3963745a2f) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:35.885910 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c9cc9-53bd-436d-9ad0-7bf4f84cdb1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:35.887383 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c9cc9-53bd-436d-9ad0-7bf4f84cdb1d None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:35.910033 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 228/446] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Oct 8 20:33:35 2022] GET /identity/v3/role_assignments?group.id=21a98ebc20b4444a8e490b2a087edc4a&scope.project.id=8a98056efe76460d9e79ef3963745a2f&role.id=fc58707301804afca34ac8fe194639ed => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:35.910033 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c9cc9-53bd-436d-9ad0-7bf4f84cdb1d None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:35.981248 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 219/447] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:35.986865 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044195ed-0271-44dc-bb71-940bb992711b None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:36.030187 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c9cc9-53bd-436d-9ad0-7bf4f84cdb1d None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:36.077347 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d4c23-7249-4d9b-9d39-38f1eae63e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:36.078398 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d4c23-7249-4d9b-9d39-38f1eae63e61 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:36.078878 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d4c23-7249-4d9b-9d39-38f1eae63e61 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:36.079349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d4c23-7249-4d9b-9d39-38f1eae63e61 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:36.080296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d4c23-7249-4d9b-9d39-38f1eae63e61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:36.080848 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d4c23-7249-4d9b-9d39-38f1eae63e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:36.083076 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d4c23-7249-4d9b-9d39-38f1eae63e61 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:36.093323 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 229/448] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:36.101616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d4c23-7249-4d9b-9d39-38f1eae63e61 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:36.105872 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:36.109983 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044195ed-0271-44dc-bb71-940bb992711b None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:36.121121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:36.160779 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea231dd7-be5e-46b8-b83d-2f86170b155a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:36.161427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea231dd7-be5e-46b8-b83d-2f86170b155a None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:36.161703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea231dd7-be5e-46b8-b83d-2f86170b155a None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:36.162581 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea231dd7-be5e-46b8-b83d-2f86170b155a None admin] PATH_INFO: `/v3/projects/552b2e45ebde4268bba84c6dbc8036cb` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:36.163954 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea231dd7-be5e-46b8-b83d-2f86170b155a None admin] RBAC: Authorizing `identity:get_project(project_id=552b2e45ebde4268bba84c6dbc8036cb)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:36.165402 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea231dd7-be5e-46b8-b83d-2f86170b155a None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:36.167326 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 220/449] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:35 2022] GET /identity/v3/projects/552b2e45ebde4268bba84c6dbc8036cb => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:36.173268 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea231dd7-be5e-46b8-b83d-2f86170b155a None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:36.244409 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d4c23-7249-4d9b-9d39-38f1eae63e61 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:36.289259 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c8d41-9faf-41d0-9865-d8eee2c7cd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:36.289875 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c8d41-9faf-41d0-9865-d8eee2c7cd5b None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:36.290205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c8d41-9faf-41d0-9865-d8eee2c7cd5b None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:36.290486 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c8d41-9faf-41d0-9865-d8eee2c7cd5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:36.293038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea231dd7-be5e-46b8-b83d-2f86170b155a None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:36.334994 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc8ecf-aac7-4ada-b897-a77dc7c5da38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:36.335635 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc8ecf-aac7-4ada-b897-a77dc7c5da38 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:36.336210 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc8ecf-aac7-4ada-b897-a77dc7c5da38 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:36.336210 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc8ecf-aac7-4ada-b897-a77dc7c5da38 None admin] PATH_INFO: `/v3/groups/d55141dd1f9c4438852b135998c96b6a` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:36.337323 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc8ecf-aac7-4ada-b897-a77dc7c5da38 None admin] RBAC: Authorizing `identity:get_group(group_id=d55141dd1f9c4438852b135998c96b6a)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:36.338796 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc8ecf-aac7-4ada-b897-a77dc7c5da38 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:36.340524 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 221/450] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Oct 8 20:33:36 2022] GET /identity/v3/groups/d55141dd1f9c4438852b135998c96b6a => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:36.346400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc8ecf-aac7-4ada-b897-a77dc7c5da38 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:36.365692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c8d41-9faf-41d0-9865-d8eee2c7cd5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:36.367151 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c8d41-9faf-41d0-9865-d8eee2c7cd5b None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:36.368928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:36.392022 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:36.445643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc8ecf-aac7-4ada-b897-a77dc7c5da38 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:36.463819 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 230/451] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 08 20:33:36.469453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c8d41-9faf-41d0-9865-d8eee2c7cd5b None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:36.480355 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef21ee-2659-43be-8bc2-98c208916cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:36.480951 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef21ee-2659-43be-8bc2-98c208916cb2 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:36.481324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef21ee-2659-43be-8bc2-98c208916cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:36.481507 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef21ee-2659-43be-8bc2-98c208916cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:36.482245 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef21ee-2659-43be-8bc2-98c208916cb2 None admin] RBAC: Adding query filter params (group.id=d55141dd1f9c4438852b135998c96b6a, role.id=323ca657fe7b4b878fd8328ef78f29f4, scope.project.id=552b2e45ebde4268bba84c6dbc8036cb) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:36.482546 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef21ee-2659-43be-8bc2-98c208916cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:36.484207 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef21ee-2659-43be-8bc2-98c208916cb2 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:36.491684 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 222/452] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Oct 8 20:33:36 2022] GET /identity/v3/role_assignments?group.id=d55141dd1f9c4438852b135998c96b6a&scope.project.id=552b2e45ebde4268bba84c6dbc8036cb&role.id=323ca657fe7b4b878fd8328ef78f29f4 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:36.573581 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c8d41-9faf-41d0-9865-d8eee2c7cd5b None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:36.575130 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:36.610403 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a7ec3-994b-433b-ac3e-0e43eb688838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:36.611048 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a7ec3-994b-433b-ac3e-0e43eb688838 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:36.611330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a7ec3-994b-433b-ac3e-0e43eb688838 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:36.611603 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a7ec3-994b-433b-ac3e-0e43eb688838 None admin] PATH_INFO: `/v3/projects/8a98056efe76460d9e79ef3963745a2f` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:36.613288 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a7ec3-994b-433b-ac3e-0e43eb688838 None admin] RBAC: Authorizing `identity:get_project(project_id=8a98056efe76460d9e79ef3963745a2f)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:36.614772 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a7ec3-994b-433b-ac3e-0e43eb688838 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:36.616433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 231/453] 10.222.0.36 () {56 vars in 1186 bytes} [Sat Oct 8 20:33:36 2022] GET /identity/v3/projects/8a98056efe76460d9e79ef3963745a2f => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:36.622105 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef21ee-2659-43be-8bc2-98c208916cb2 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:36.727006 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef21ee-2659-43be-8bc2-98c208916cb2 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:36.736283 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:36.761994 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa608cc-7f17-41de-9bd3-20bc2c87f2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:36.762619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa608cc-7f17-41de-9bd3-20bc2c87f2e1 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:36.762901 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa608cc-7f17-41de-9bd3-20bc2c87f2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:36.763176 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa608cc-7f17-41de-9bd3-20bc2c87f2e1 None admin] PATH_INFO: `/v3/groups/21a98ebc20b4444a8e490b2a087edc4a` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:36.764260 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa608cc-7f17-41de-9bd3-20bc2c87f2e1 None admin] RBAC: Authorizing `identity:get_group(group_id=21a98ebc20b4444a8e490b2a087edc4a)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:36.765683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa608cc-7f17-41de-9bd3-20bc2c87f2e1 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:36.767273 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 223/454] 10.222.0.36 () {56 vars in 1180 bytes} [Sat Oct 8 20:33:36 2022] GET /identity/v3/groups/21a98ebc20b4444a8e490b2a087edc4a => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:36.773397 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a7ec3-994b-433b-ac3e-0e43eb688838 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:36.867639 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a7ec3-994b-433b-ac3e-0e43eb688838 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:36.899061 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636db69e-cd06-4d34-9fe9-879723f85d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:36.899643 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636db69e-cd06-4d34-9fe9-879723f85d7e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:36.899917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636db69e-cd06-4d34-9fe9-879723f85d7e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:36.900183 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636db69e-cd06-4d34-9fe9-879723f85d7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:36.900885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636db69e-cd06-4d34-9fe9-879723f85d7e None admin] RBAC: Adding query filter params (group.id=21a98ebc20b4444a8e490b2a087edc4a, role.id=04e5ea25342a4845b0df239f7f2b0705, scope.project.id=8a98056efe76460d9e79ef3963745a2f) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:36.901194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636db69e-cd06-4d34-9fe9-879723f85d7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:36.902616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636db69e-cd06-4d34-9fe9-879723f85d7e None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:36.908006 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 232/455] 10.222.0.36 () {56 vars in 1376 bytes} [Sat Oct 8 20:33:36 2022] GET /identity/v3/role_assignments?group.id=21a98ebc20b4444a8e490b2a087edc4a&scope.project.id=8a98056efe76460d9e79ef3963745a2f&role.id=04e5ea25342a4845b0df239f7f2b0705 => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:39.795072 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec624a-70b4-4b1b-aed1-92cc09fb88e9 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:39.796129 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec624a-70b4-4b1b-aed1-92cc09fb88e9 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:39.796615 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec624a-70b4-4b1b-aed1-92cc09fb88e9 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:39.798449 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 224/456] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:39.804676 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eb00a-f540-4c51-8fdb-aad0b849de44 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:39.805491 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eb00a-f540-4c51-8fdb-aad0b849de44 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:39.806006 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eb00a-f540-4c51-8fdb-aad0b849de44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:39.825304 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-7e3eb00a-f540-4c51-8fdb-aad0b849de44 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:39.826912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-7e3eb00a-f540-4c51-8fdb-aad0b849de44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:39.856287 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:39.901211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 233/457] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:40.017144 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81182905-6302-49bf-84a3-f55f09c15582 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:40.017666 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81182905-6302-49bf-84a3-f55f09c15582 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:40.018121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81182905-6302-49bf-84a3-f55f09c15582 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:40.020331 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 225/458] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:40.027940 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb3a48-021f-4a67-84c8-6e95d7f7501d None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:40.028577 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb3a48-021f-4a67-84c8-6e95d7f7501d None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:40.029050 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb3a48-021f-4a67-84c8-6e95d7f7501d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:40.063902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-66fb3a48-021f-4a67-84c8-6e95d7f7501d None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:40.065357 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-66fb3a48-021f-4a67-84c8-6e95d7f7501d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:40.086525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76a000-5675-4d6a-815e-d279ce009ab3 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:40.086525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76a000-5675-4d6a-815e-d279ce009ab3 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:40.086525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76a000-5675-4d6a-815e-d279ce009ab3 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:40.086525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 226/459] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:40.091710 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa318dd-37dc-4cd9-87c7-f52ed946e927 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:40.092234 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa318dd-37dc-4cd9-87c7-f52ed946e927 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:40.092707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa318dd-37dc-4cd9-87c7-f52ed946e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:40.119649 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-aaa318dd-37dc-4cd9-87c7-f52ed946e927 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:40.121849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-aaa318dd-37dc-4cd9-87c7-f52ed946e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:40.141938 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 234/460] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:40.199044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 227/461] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:33:40.269390 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb3a48-021f-4a67-84c8-6e95d7f7501d None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:40.369588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:40.380697 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb3a48-021f-4a67-84c8-6e95d7f7501d None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:40.419418 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260ad77-74d1-4bda-9bd1-6a7ee6c3367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:40.420077 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260ad77-74d1-4bda-9bd1-6a7ee6c3367f None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:40.420356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260ad77-74d1-4bda-9bd1-6a7ee6c3367f None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:40.420629 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260ad77-74d1-4bda-9bd1-6a7ee6c3367f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:40.431850 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260ad77-74d1-4bda-9bd1-6a7ee6c3367f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:40.433302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260ad77-74d1-4bda-9bd1-6a7ee6c3367f None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-2260ad77-74d1-4bda-9bd1-6a7ee6c3367f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:40.448860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:40.449804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:40.450750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:40.450750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:40.450750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:40.450750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 235/462] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:40.455921 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa318dd-37dc-4cd9-87c7-f52ed946e927 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:40.462051 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0a7d7-07d2-4fc4-889e-c12a74fbf1db None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:40.462336 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0a7d7-07d2-4fc4-889e-c12a74fbf1db None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:40.462604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0a7d7-07d2-4fc4-889e-c12a74fbf1db None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:40.464137 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 236/463] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:33:40.468869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74808603-5ccd-4394-b467-7552cb661d58 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:40.469145 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74808603-5ccd-4394-b467-7552cb661d58 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:40.469412 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74808603-5ccd-4394-b467-7552cb661d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:40.489971 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-74808603-5ccd-4394-b467-7552cb661d58 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:40.491395 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-74808603-5ccd-4394-b467-7552cb661d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:40.565385 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 237/464] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:33:40.566910 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74808603-5ccd-4394-b467-7552cb661d58 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:40.573251 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa318dd-37dc-4cd9-87c7-f52ed946e927 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:40.583047 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:40.614816 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcaf89-7799-458d-86d2-3ed3f35272a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:40.615444 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcaf89-7799-458d-86d2-3ed3f35272a6 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:40.615776 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcaf89-7799-458d-86d2-3ed3f35272a6 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:40.615974 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcaf89-7799-458d-86d2-3ed3f35272a6 None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:40.616614 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcaf89-7799-458d-86d2-3ed3f35272a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:40.617238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcaf89-7799-458d-86d2-3ed3f35272a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:40.618329 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcaf89-7799-458d-86d2-3ed3f35272a6 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:40.640029 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 228/465] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:40.640029 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcaf89-7799-458d-86d2-3ed3f35272a6 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:40.653321 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:40.679657 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74808603-5ccd-4394-b467-7552cb661d58 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:40.718091 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fbc0c-f421-4d79-a0f7-f2af16c148c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:40.719486 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fbc0c-f421-4d79-a0f7-f2af16c148c7 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:40.719977 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fbc0c-f421-4d79-a0f7-f2af16c148c7 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:40.720795 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fbc0c-f421-4d79-a0f7-f2af16c148c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:40.732904 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fbc0c-f421-4d79-a0f7-f2af16c148c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:40.734771 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fbc0c-f421-4d79-a0f7-f2af16c148c7 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:40.744610 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcaf89-7799-458d-86d2-3ed3f35272a6 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-ca8fbc0c-f421-4d79-a0f7-f2af16c148c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:40.749005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:40.749912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:40.750813 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:40.750813 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:40.750813 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:40.750813 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 238/466] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:40.751439 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fbc0c-f421-4d79-a0f7-f2af16c148c7 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:40.786795 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9511b-6af7-4940-b0dc-d7783a1ee52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:40.787425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9511b-6af7-4940-b0dc-d7783a1ee52a None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:40.787703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9511b-6af7-4940-b0dc-d7783a1ee52a None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:40.787986 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9511b-6af7-4940-b0dc-d7783a1ee52a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:40.798510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9511b-6af7-4940-b0dc-d7783a1ee52a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:40.800017 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9511b-6af7-4940-b0dc-d7783a1ee52a None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-5fc9511b-6af7-4940-b0dc-d7783a1ee52a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:40.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:40.817012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:40.817932 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:40.817932 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:40.817932 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:40.817932 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 229/467] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:40.817932 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9511b-6af7-4940-b0dc-d7783a1ee52a None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:40.837442 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:40.864541 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fbc0c-f421-4d79-a0f7-f2af16c148c7 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:40.891902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:40.900883 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc05139-fa7e-498e-8a5e-6564c6048dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:40.901492 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc05139-fa7e-498e-8a5e-6564c6048dbd None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:40.901770 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc05139-fa7e-498e-8a5e-6564c6048dbd None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:40.902077 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc05139-fa7e-498e-8a5e-6564c6048dbd None admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:40.902718 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc05139-fa7e-498e-8a5e-6564c6048dbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:40.904123 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc05139-fa7e-498e-8a5e-6564c6048dbd None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:40.925855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 239/468] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Oct 8 20:33:40 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:33:40.926486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9511b-6af7-4940-b0dc-d7783a1ee52a None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:40.926880 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc05139-fa7e-498e-8a5e-6564c6048dbd None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:40.963070 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98797c-811d-489f-a233-5f5b75a5ef84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:40.963706 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98797c-811d-489f-a233-5f5b75a5ef84 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:40.964003 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98797c-811d-489f-a233-5f5b75a5ef84 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:40.964262 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98797c-811d-489f-a233-5f5b75a5ef84 None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:40.964909 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98797c-811d-489f-a233-5f5b75a5ef84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:40.965216 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98797c-811d-489f-a233-5f5b75a5ef84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:40.966661 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98797c-811d-489f-a233-5f5b75a5ef84 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:40.979689 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 230/469] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:40.980547 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98797c-811d-489f-a233-5f5b75a5ef84 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:41.063862 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc05139-fa7e-498e-8a5e-6564c6048dbd None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:41.073742 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:41.099542 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98797c-811d-489f-a233-5f5b75a5ef84 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:41.104961 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f1da2-2038-4ca8-b6bf-42573a1352c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:41.105585 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f1da2-2038-4ca8-b6bf-42573a1352c3 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:41.105862 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f1da2-2038-4ca8-b6bf-42573a1352c3 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:41.106204 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f1da2-2038-4ca8-b6bf-42573a1352c3 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:41.106922 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f1da2-2038-4ca8-b6bf-42573a1352c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:41.107226 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f1da2-2038-4ca8-b6bf-42573a1352c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:41.108862 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f1da2-2038-4ca8-b6bf-42573a1352c3 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:41.126025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 240/470] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:41.126025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f1da2-2038-4ca8-b6bf-42573a1352c3 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:41.147246 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f44a92-30de-4205-aec1-14f790197fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:41.147819 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f44a92-30de-4205-aec1-14f790197fcd None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:41.148100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f44a92-30de-4205-aec1-14f790197fcd None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:41.148378 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f44a92-30de-4205-aec1-14f790197fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:41.161326 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f44a92-30de-4205-aec1-14f790197fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:41.162813 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f44a92-30de-4205-aec1-14f790197fcd None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:41.178544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-75f44a92-30de-4205-aec1-14f790197fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:41.185079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:41.186038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:41.187078 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:41.187078 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:41.187078 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:41.188804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 231/471] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:41.189790 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f44a92-30de-4205-aec1-14f790197fcd None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:41.241838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f1da2-2038-4ca8-b6bf-42573a1352c3 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:41.280570 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b77e54-ffb1-4b7d-b43f-8767561ac90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:41.281191 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b77e54-ffb1-4b7d-b43f-8767561ac90f None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:41.281464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b77e54-ffb1-4b7d-b43f-8767561ac90f None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:41.281732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b77e54-ffb1-4b7d-b43f-8767561ac90f None admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:41.282414 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b77e54-ffb1-4b7d-b43f-8767561ac90f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:41.285122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b77e54-ffb1-4b7d-b43f-8767561ac90f None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:41.293566 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f44a92-30de-4205-aec1-14f790197fcd None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:41.311992 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 241/472] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Oct 8 20:33:41 2022] POST /identity/v3/users => generated 248 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:33:41.312841 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b77e54-ffb1-4b7d-b43f-8767561ac90f None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:41.325324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:41.332650 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc6cd8-bcdc-4851-9e07-856c29447d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:41.333001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc6cd8-bcdc-4851-9e07-856c29447d32 None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:41.333420 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc6cd8-bcdc-4851-9e07-856c29447d32 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:41.333696 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc6cd8-bcdc-4851-9e07-856c29447d32 None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:41.334313 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc6cd8-bcdc-4851-9e07-856c29447d32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:41.336037 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc6cd8-bcdc-4851-9e07-856c29447d32 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:41.370155 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 232/473] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Oct 8 20:33:41 2022] POST /identity/v3/users => generated 248 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:33:41.446304 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:41.450094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b77e54-ffb1-4b7d-b43f-8767561ac90f None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:41.492905 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee43b6-dd06-4623-8e97-a7ad3a079850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:41.493538 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee43b6-dd06-4623-8e97-a7ad3a079850 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:41.493816 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee43b6-dd06-4623-8e97-a7ad3a079850 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:41.494120 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee43b6-dd06-4623-8e97-a7ad3a079850 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:41.494771 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee43b6-dd06-4623-8e97-a7ad3a079850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:41.495074 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee43b6-dd06-4623-8e97-a7ad3a079850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:41.496477 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee43b6-dd06-4623-8e97-a7ad3a079850 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:41.510558 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 242/474] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:41.519928 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc6cd8-bcdc-4851-9e07-856c29447d32 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:41.640333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc6cd8-bcdc-4851-9e07-856c29447d32 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:41.678290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12a0cf-fd94-47bd-976e-80c26e71c755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:41.679075 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12a0cf-fd94-47bd-976e-80c26e71c755 None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:41.679357 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12a0cf-fd94-47bd-976e-80c26e71c755 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:41.679631 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12a0cf-fd94-47bd-976e-80c26e71c755 None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:41.680283 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12a0cf-fd94-47bd-976e-80c26e71c755 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:41.681732 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12a0cf-fd94-47bd-976e-80c26e71c755 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:41.706772 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 233/475] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Oct 8 20:33:41 2022] POST /identity/v3/users => generated 249 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:33:43.465053 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af596565-c5e1-44ae-80c0-aa9897c3bff3 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:43.465614 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af596565-c5e1-44ae-80c0-aa9897c3bff3 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:43.465614 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af596565-c5e1-44ae-80c0-aa9897c3bff3 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:43.467199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 243/476] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:43.473489 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e3d7e-ad5f-4364-a725-c5896005e443 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:43.474527 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e3d7e-ad5f-4364-a725-c5896005e443 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:43.475036 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e3d7e-ad5f-4364-a725-c5896005e443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:43.496090 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-663e3d7e-ad5f-4364-a725-c5896005e443 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:43.497681 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-663e3d7e-ad5f-4364-a725-c5896005e443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:43.537137 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:43.583411 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 234/477] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:43.922432 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af596565-c5e1-44ae-80c0-aa9897c3bff3 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:43.935940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef1b4e-2e4f-4575-98a8-3df0c58b44d7 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:43.936510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef1b4e-2e4f-4575-98a8-3df0c58b44d7 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:43.937026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef1b4e-2e4f-4575-98a8-3df0c58b44d7 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:43.938750 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 235/478] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:43.944132 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb52df-6bdb-4914-bf52-68e6bd96f3a7 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:43.944671 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb52df-6bdb-4914-bf52-68e6bd96f3a7 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:43.945129 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb52df-6bdb-4914-bf52-68e6bd96f3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:43.964288 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-9eeb52df-6bdb-4914-bf52-68e6bd96f3a7 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:43.965876 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-9eeb52df-6bdb-4914-bf52-68e6bd96f3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:44.043986 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 236/479] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:33:44.045606 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771285d-6bc7-4c3a-9ea9-6e0056760510 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:44.046142 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771285d-6bc7-4c3a-9ea9-6e0056760510 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:44.046636 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771285d-6bc7-4c3a-9ea9-6e0056760510 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:44.048320 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 237/480] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:44.052653 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af596565-c5e1-44ae-80c0-aa9897c3bff3 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:44.068450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077478be-85da-4667-80b9-51c455d1757b None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:44.068450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077478be-85da-4667-80b9-51c455d1757b None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:44.068450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077478be-85da-4667-80b9-51c455d1757b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:44.084613 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-077478be-85da-4667-80b9-51c455d1757b None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:44.085962 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-077478be-85da-4667-80b9-51c455d1757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:44.094054 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096de75-4560-4eb5-bfeb-3c6382f5942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:44.094706 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096de75-4560-4eb5-bfeb-3c6382f5942b None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:44.094987 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096de75-4560-4eb5-bfeb-3c6382f5942b None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:44.095264 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096de75-4560-4eb5-bfeb-3c6382f5942b None admin] PATH_INFO: `/v3/roles/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:44.109744 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096de75-4560-4eb5-bfeb-3c6382f5942b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-7096de75-4560-4eb5-bfeb-3c6382f5942b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:44.115596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:44.116544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:44.117373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:44.117373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:44.117373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:44.117373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:44.117373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:44.117373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:44.117373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:44.117373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:44.117373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:44.117373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:44.117373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:44.117373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:44.117373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 244/481] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:33:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:44.126915 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096de75-4560-4eb5-bfeb-3c6382f5942b None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:44.156133 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:44.174499 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 238/482] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:44.224808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930dc2a-6179-492e-b3fc-1d7fa8f3c4bc None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:44.225125 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930dc2a-6179-492e-b3fc-1d7fa8f3c4bc None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:44.225374 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930dc2a-6179-492e-b3fc-1d7fa8f3c4bc None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:44.226735 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 239/483] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:33:44.231731 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75523d-fdab-462d-9a50-8fd0ecff714a None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:44.232214 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75523d-fdab-462d-9a50-8fd0ecff714a None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:44.232687 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75523d-fdab-462d-9a50-8fd0ecff714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:44.249379 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096de75-4560-4eb5-bfeb-3c6382f5942b None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:44.253916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-fe75523d-fdab-462d-9a50-8fd0ecff714a None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:44.255306 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-fe75523d-fdab-462d-9a50-8fd0ecff714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:44.281768 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:44.291749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876bd33-4fcd-4900-95d1-87feec2a29f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:44.292658 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876bd33-4fcd-4900-95d1-87feec2a29f1 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:44.293139 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876bd33-4fcd-4900-95d1-87feec2a29f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:44.293619 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876bd33-4fcd-4900-95d1-87feec2a29f1 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:44.294515 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876bd33-4fcd-4900-95d1-87feec2a29f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:44.295030 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876bd33-4fcd-4900-95d1-87feec2a29f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:44.296587 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876bd33-4fcd-4900-95d1-87feec2a29f1 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:44.305955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 245/484] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Oct 8 20:33:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:44.311420 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876bd33-4fcd-4900-95d1-87feec2a29f1 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:44.342133 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 240/485] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:33:44.391324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75523d-fdab-462d-9a50-8fd0ecff714a None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:44.408003 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:44.432228 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876bd33-4fcd-4900-95d1-87feec2a29f1 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:44.474009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bc76d-5679-4916-9b44-88a336b8c474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:44.475643 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bc76d-5679-4916-9b44-88a336b8c474 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:44.476548 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bc76d-5679-4916-9b44-88a336b8c474 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:44.477302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bc76d-5679-4916-9b44-88a336b8c474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:44.490224 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bc76d-5679-4916-9b44-88a336b8c474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:44.492406 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bc76d-5679-4916-9b44-88a336b8c474 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:44.500754 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75523d-fdab-462d-9a50-8fd0ecff714a None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-127bc76d-5679-4916-9b44-88a336b8c474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:44.509349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:44.510471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:44.511354 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:44.511354 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:44.511354 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:44.513243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 246/486] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:33:44.519036 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bc76d-5679-4916-9b44-88a336b8c474 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:44.542959 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b4a44-66ef-4ada-b690-3829019ac4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:44.543891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b4a44-66ef-4ada-b690-3829019ac4ff None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:44.544315 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b4a44-66ef-4ada-b690-3829019ac4ff None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:44.544735 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b4a44-66ef-4ada-b690-3829019ac4ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:44.555963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b4a44-66ef-4ada-b690-3829019ac4ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-005b4a44-66ef-4ada-b690-3829019ac4ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:44.561242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:44.562371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:44.563363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:44.563363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:44.563363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:44.563363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:44.563363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:44.563363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:44.563363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:44.563363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:44.563363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:44.563363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:44.563363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:44.563363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:44.570647 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 241/487] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:33:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:33:44.570882 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b4a44-66ef-4ada-b690-3829019ac4ff None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:44.596124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:44.631539 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bc76d-5679-4916-9b44-88a336b8c474 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:44.668178 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfd1a4-3bbc-476d-830d-54d6dfc06b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:44.668835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfd1a4-3bbc-476d-830d-54d6dfc06b4f None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:44.669248 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfd1a4-3bbc-476d-830d-54d6dfc06b4f None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:44.669522 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfd1a4-3bbc-476d-830d-54d6dfc06b4f None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:44.670237 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfd1a4-3bbc-476d-830d-54d6dfc06b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:44.670542 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfd1a4-3bbc-476d-830d-54d6dfc06b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:44.671896 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfd1a4-3bbc-476d-830d-54d6dfc06b4f None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:44.673605 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:44.685420 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b4a44-66ef-4ada-b690-3829019ac4ff None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:44.691205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 247/488] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:44.691205 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfd1a4-3bbc-476d-830d-54d6dfc06b4f None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:44.718838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56575daa-7eb5-4759-84b5-485f0e7ad906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:44.719483 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56575daa-7eb5-4759-84b5-485f0e7ad906 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:44.719746 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56575daa-7eb5-4759-84b5-485f0e7ad906 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:44.720020 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56575daa-7eb5-4759-84b5-485f0e7ad906 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:44.730592 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56575daa-7eb5-4759-84b5-485f0e7ad906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-56575daa-7eb5-4759-84b5-485f0e7ad906 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:44.735594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:44.736514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:44.738053 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:44.738053 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:44.738053 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:44.738053 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:44.738053 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:44.738053 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:44.738053 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:44.738053 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:44.738053 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:44.738053 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:44.738053 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:44.738053 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:44.738053 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 242/489] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:33:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:44.738977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56575daa-7eb5-4759-84b5-485f0e7ad906 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:44.789414 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfd1a4-3bbc-476d-830d-54d6dfc06b4f None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:44.818907 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:44.824217 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ef11e-5bbb-4944-90c3-8a9b0ccdcfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:44.824829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ef11e-5bbb-4944-90c3-8a9b0ccdcfbf None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:44.825111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ef11e-5bbb-4944-90c3-8a9b0ccdcfbf None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:44.825817 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ef11e-5bbb-4944-90c3-8a9b0ccdcfbf None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:44.826519 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ef11e-5bbb-4944-90c3-8a9b0ccdcfbf None admin] RBAC: Adding query filter params (name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:44.826830 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ef11e-5bbb-4944-90c3-8a9b0ccdcfbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:44.828214 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ef11e-5bbb-4944-90c3-8a9b0ccdcfbf None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:44.836253 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 248/490] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Oct 8 20:33:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:44.837032 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ef11e-5bbb-4944-90c3-8a9b0ccdcfbf None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:44.837204 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56575daa-7eb5-4759-84b5-485f0e7ad906 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:44.871695 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d68f32-b94c-42ce-a8b4-645dcc3820e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:44.872318 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d68f32-b94c-42ce-a8b4-645dcc3820e2 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:44.872599 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d68f32-b94c-42ce-a8b4-645dcc3820e2 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:44.872873 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d68f32-b94c-42ce-a8b4-645dcc3820e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:44.883176 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d68f32-b94c-42ce-a8b4-645dcc3820e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-37d68f32-b94c-42ce-a8b4-645dcc3820e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:44.887931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:44.888809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:44.889597 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:44.889597 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:44.889597 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:44.889597 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:44.889597 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:44.889597 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:44.889597 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:44.889597 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:44.889597 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:44.889597 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:44.889597 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:44.889597 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:44.889597 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 243/491] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:33:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:44.890376 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d68f32-b94c-42ce-a8b4-645dcc3820e2 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:44.895396 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:44.937353 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ef11e-5bbb-4944-90c3-8a9b0ccdcfbf None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:44.970864 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f04ce-ad0f-4f09-80ba-ef0e47bb1fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:44.971490 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f04ce-ad0f-4f09-80ba-ef0e47bb1fb3 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:44.971867 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f04ce-ad0f-4f09-80ba-ef0e47bb1fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:44.972089 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f04ce-ad0f-4f09-80ba-ef0e47bb1fb3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:44.979539 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f04ce-ad0f-4f09-80ba-ef0e47bb1fb3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:44.980968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f04ce-ad0f-4f09-80ba-ef0e47bb1fb3 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:44.989567 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d68f32-b94c-42ce-a8b4-645dcc3820e2 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-a26f04ce-ad0f-4f09-80ba-ef0e47bb1fb3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:33:44.994269 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:44.995364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:44.996512 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:44.996512 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:44.996512 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:33:44.996512 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:33:44.996512 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:33:44.996512 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:33:44.996512 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:33:44.996512 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:33:44.996512 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:33:44.996512 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:44.996512 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 249/492] 10.222.0.36 () {56 vars in 1093 bytes} [Sat Oct 8 20:33:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:44.996512 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f04ce-ad0f-4f09-80ba-ef0e47bb1fb3 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:45.023886 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd8315-06b3-4d5d-891b-cf63d7d310a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:45.024490 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd8315-06b3-4d5d-891b-cf63d7d310a5 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:45.024772 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd8315-06b3-4d5d-891b-cf63d7d310a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:45.025046 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd8315-06b3-4d5d-891b-cf63d7d310a5 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:45.025708 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd8315-06b3-4d5d-891b-cf63d7d310a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:45.026046 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd8315-06b3-4d5d-891b-cf63d7d310a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:45.027411 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd8315-06b3-4d5d-891b-cf63d7d310a5 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:45.035404 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 244/493] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Oct 8 20:33:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:45.036193 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd8315-06b3-4d5d-891b-cf63d7d310a5 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:45.041529 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:45.099321 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f04ce-ad0f-4f09-80ba-ef0e47bb1fb3 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:45.115536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:45.133848 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a68d4-ba5d-4ff3-bc5b-185657560a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:45.134613 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a68d4-ba5d-4ff3-bc5b-185657560a9e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:45.134786 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a68d4-ba5d-4ff3-bc5b-185657560a9e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:45.135058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a68d4-ba5d-4ff3-bc5b-185657560a9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:45.137990 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd8315-06b3-4d5d-891b-cf63d7d310a5 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:45.145682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a68d4-ba5d-4ff3-bc5b-185657560a9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:45.147156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a68d4-ba5d-4ff3-bc5b-185657560a9e None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-764a68d4-ba5d-4ff3-bc5b-185657560a9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:45.161681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:45.162782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:45.163999 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:45.163999 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:45.163999 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:45.163999 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 250/494] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:45.163999 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a68d4-ba5d-4ff3-bc5b-185657560a9e None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:45.176245 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13182c60-7379-4790-a75c-35a6e77c093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:45.176849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13182c60-7379-4790-a75c-35a6e77c093a None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:45.177133 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13182c60-7379-4790-a75c-35a6e77c093a None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:45.177409 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13182c60-7379-4790-a75c-35a6e77c093a None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:45.178103 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13182c60-7379-4790-a75c-35a6e77c093a None admin] RBAC: Adding query filter params (name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:45.178409 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13182c60-7379-4790-a75c-35a6e77c093a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:45.179758 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13182c60-7379-4790-a75c-35a6e77c093a None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:45.187615 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 245/495] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Oct 8 20:33:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:45.188328 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13182c60-7379-4790-a75c-35a6e77c093a None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:45.255293 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:45.262681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a68d4-ba5d-4ff3-bc5b-185657560a9e None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:45.290746 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13182c60-7379-4790-a75c-35a6e77c093a None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:45.296404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a7d91-e24e-4b7c-8f5c-c1b2bd5ce757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:45.297010 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a7d91-e24e-4b7c-8f5c-c1b2bd5ce757 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:45.297349 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a7d91-e24e-4b7c-8f5c-c1b2bd5ce757 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:45.297633 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a7d91-e24e-4b7c-8f5c-c1b2bd5ce757 None admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:45.298383 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a7d91-e24e-4b7c-8f5c-c1b2bd5ce757 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:45.298692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a7d91-e24e-4b7c-8f5c-c1b2bd5ce757 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:45.301054 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a7d91-e24e-4b7c-8f5c-c1b2bd5ce757 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:45.324185 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1d0b9-44d7-438f-a39c-cb76837c0459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:45.324785 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1d0b9-44d7-438f-a39c-cb76837c0459 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:45.325062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1d0b9-44d7-438f-a39c-cb76837c0459 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:45.325330 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1d0b9-44d7-438f-a39c-cb76837c0459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:45.336335 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1d0b9-44d7-438f-a39c-cb76837c0459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:45.337066 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 251/496] 10.222.0.36 () {56 vars in 1133 bytes} [Sat Oct 8 20:33:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:45.337759 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1d0b9-44d7-438f-a39c-cb76837c0459 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:45.337953 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a7d91-e24e-4b7c-8f5c-c1b2bd5ce757 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-09f1d0b9-44d7-438f-a39c-cb76837c0459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:45.352508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:45.353436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:45.354335 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:45.354335 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:45.354335 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:45.354335 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 246/497] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:45.354335 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1d0b9-44d7-438f-a39c-cb76837c0459 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:45.372010 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:45.442414 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a7d91-e24e-4b7c-8f5c-c1b2bd5ce757 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:45.451280 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1d0b9-44d7-438f-a39c-cb76837c0459 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:45.467497 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:45.475478 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e7013-2938-4393-af85-cc0e17da5369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:45.476079 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7013-2938-4393-af85-cc0e17da5369 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:45.476356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7013-2938-4393-af85-cc0e17da5369 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:45.476628 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7013-2938-4393-af85-cc0e17da5369 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:45.477260 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e7013-2938-4393-af85-cc0e17da5369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:45.477560 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e7013-2938-4393-af85-cc0e17da5369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:45.478970 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e7013-2938-4393-af85-cc0e17da5369 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:45.485252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bb56c-b6ee-43c9-a39d-217bb407acf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:45.485862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bb56c-b6ee-43c9-a39d-217bb407acf3 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:45.486168 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bb56c-b6ee-43c9-a39d-217bb407acf3 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:45.486438 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bb56c-b6ee-43c9-a39d-217bb407acf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:45.490830 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 252/498] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:45.491613 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e7013-2938-4393-af85-cc0e17da5369 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:45.499155 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bb56c-b6ee-43c9-a39d-217bb407acf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:45.500984 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bb56c-b6ee-43c9-a39d-217bb407acf3 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-411bb56c-b6ee-43c9-a39d-217bb407acf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:45.515425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:45.516427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:45.522342 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:45.522342 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:45.522342 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:45.522342 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 247/499] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:45.522342 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bb56c-b6ee-43c9-a39d-217bb407acf3 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:45.576580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:45.592194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e7013-2938-4393-af85-cc0e17da5369 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:45.618126 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bb56c-b6ee-43c9-a39d-217bb407acf3 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:45.625809 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297733f-12a1-43f4-b14d-2c890bd67459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:45.626454 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297733f-12a1-43f4-b14d-2c890bd67459 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:45.626736 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297733f-12a1-43f4-b14d-2c890bd67459 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:45.627367 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297733f-12a1-43f4-b14d-2c890bd67459 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:45.651396 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c673d9-e9d6-4ad7-91ef-af92b1a5736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:45.651993 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c673d9-e9d6-4ad7-91ef-af92b1a5736a None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:45.652273 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c673d9-e9d6-4ad7-91ef-af92b1a5736a None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:45.652556 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c673d9-e9d6-4ad7-91ef-af92b1a5736a None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:45.653187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c673d9-e9d6-4ad7-91ef-af92b1a5736a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:45.653490 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c673d9-e9d6-4ad7-91ef-af92b1a5736a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:45.654881 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c673d9-e9d6-4ad7-91ef-af92b1a5736a None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:45.666845 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 248/500] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:45.667625 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c673d9-e9d6-4ad7-91ef-af92b1a5736a None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:45.695841 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297733f-12a1-43f4-b14d-2c890bd67459 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:45.696819 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:45.697454 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297733f-12a1-43f4-b14d-2c890bd67459 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:45.765646 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c673d9-e9d6-4ad7-91ef-af92b1a5736a None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:45.781395 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:45.797138 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 253/501] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:45.797991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297733f-12a1-43f4-b14d-2c890bd67459 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:45.798678 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d814df0-f075-4a0e-a048-0ea1695de47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:45.799491 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d814df0-f075-4a0e-a048-0ea1695de47b None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:45.800478 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d814df0-f075-4a0e-a048-0ea1695de47b None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:45.801055 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d814df0-f075-4a0e-a048-0ea1695de47b None admin] PATH_INFO: `/v3/users/glance` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:45.808314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d814df0-f075-4a0e-a048-0ea1695de47b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:45.809732 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d814df0-f075-4a0e-a048-0ea1695de47b None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-6d814df0-f075-4a0e-a048-0ea1695de47b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:33:45.822580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:45.823601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:45.824494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:45.824494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:45.824494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:33:45.824494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:33:45.824494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:33:45.824494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:33:45.824494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:33:45.824494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:33:45.824494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 08 20:33:45.824494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:45.824494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 249/502] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:45.824494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d814df0-f075-4a0e-a048-0ea1695de47b None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:45.901404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297733f-12a1-43f4-b14d-2c890bd67459 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:45.916210 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:45.926070 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d814df0-f075-4a0e-a048-0ea1695de47b None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:45.935259 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fea93-f861-48b5-aba6-561cdb2f8495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:45.935876 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fea93-f861-48b5-aba6-561cdb2f8495 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:45.936160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fea93-f861-48b5-aba6-561cdb2f8495 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:45.936437 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fea93-f861-48b5-aba6-561cdb2f8495 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:45.937071 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fea93-f861-48b5-aba6-561cdb2f8495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:45.937375 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fea93-f861-48b5-aba6-561cdb2f8495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:45.938795 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fea93-f861-48b5-aba6-561cdb2f8495 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:45.951166 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 254/503] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:45.951814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fea93-f861-48b5-aba6-561cdb2f8495 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:45.960631 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab92ce-7bf0-4b74-a627-712078c19dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:45.961254 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab92ce-7bf0-4b74-a627-712078c19dad None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:45.961532 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab92ce-7bf0-4b74-a627-712078c19dad None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:45.961803 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab92ce-7bf0-4b74-a627-712078c19dad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:45.970274 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab92ce-7bf0-4b74-a627-712078c19dad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:45.972226 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab92ce-7bf0-4b74-a627-712078c19dad None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-44ab92ce-7bf0-4b74-a627-712078c19dad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:33:45.983187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:45.984521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:45.985445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:45.985445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:45.985445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:33:45.985445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:33:45.985445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:33:45.985445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:33:45.985445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:33:45.985445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:33:45.985445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:33:45.985445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:45.985445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 250/504] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:45.985445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab92ce-7bf0-4b74-a627-712078c19dad None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:46.001872 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:46.054509 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fea93-f861-48b5-aba6-561cdb2f8495 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:46.086258 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab92ce-7bf0-4b74-a627-712078c19dad None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:46.088760 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b40177-6c92-423a-bb23-8d7cae840729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:46.089398 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b40177-6c92-423a-bb23-8d7cae840729 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:46.089677 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b40177-6c92-423a-bb23-8d7cae840729 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:46.089986 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b40177-6c92-423a-bb23-8d7cae840729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:46.100376 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b40177-6c92-423a-bb23-8d7cae840729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:46.101792 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b40177-6c92-423a-bb23-8d7cae840729 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-48b40177-6c92-423a-bb23-8d7cae840729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:46.116838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:46.117732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:46.118634 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:46.118634 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:46.118634 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:46.118634 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 255/505] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:46.118885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b40177-6c92-423a-bb23-8d7cae840729 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:46.124534 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690953ec-c413-48d4-8af6-b2767e89c803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:46.125142 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690953ec-c413-48d4-8af6-b2767e89c803 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:46.125418 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690953ec-c413-48d4-8af6-b2767e89c803 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:46.125690 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690953ec-c413-48d4-8af6-b2767e89c803 None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:46.126438 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690953ec-c413-48d4-8af6-b2767e89c803 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:46.126744 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690953ec-c413-48d4-8af6-b2767e89c803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:46.128814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690953ec-c413-48d4-8af6-b2767e89c803 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:46.165342 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 251/506] 10.222.0.36 () {56 vars in 1137 bytes} [Sat Oct 8 20:33:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:46.166069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690953ec-c413-48d4-8af6-b2767e89c803 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:46.177332 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:46.216838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:46.220135 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b40177-6c92-423a-bb23-8d7cae840729 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:46.254328 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d107ef9-2d16-4382-84b1-504eea0a897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:46.254969 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d107ef9-2d16-4382-84b1-504eea0a897b None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:46.255247 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d107ef9-2d16-4382-84b1-504eea0a897b None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:46.255518 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d107ef9-2d16-4382-84b1-504eea0a897b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:46.262511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d107ef9-2d16-4382-84b1-504eea0a897b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:46.264203 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d107ef9-2d16-4382-84b1-504eea0a897b None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:46.266228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690953ec-c413-48d4-8af6-b2767e89c803 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-1d107ef9-2d16-4382-84b1-504eea0a897b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:33:46.276313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:46.277405 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:46.278955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:46.278955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:46.278955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:33:46.278955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:33:46.278955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:33:46.278955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:33:46.278955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:33:46.278955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:33:46.278955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 08 20:33:46.278955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:46.278955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 256/507] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:33:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:46.278955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d107ef9-2d16-4382-84b1-504eea0a897b None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:46.303982 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ff829-200c-4b82-a10f-c6657d2d0447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:46.304588 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ff829-200c-4b82-a10f-c6657d2d0447 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:46.304867 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ff829-200c-4b82-a10f-c6657d2d0447 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:46.305145 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ff829-200c-4b82-a10f-c6657d2d0447 None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:46.305865 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ff829-200c-4b82-a10f-c6657d2d0447 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:46.306207 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ff829-200c-4b82-a10f-c6657d2d0447 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:46.307649 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ff829-200c-4b82-a10f-c6657d2d0447 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:46.325145 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 252/508] 10.222.0.36 () {56 vars in 1137 bytes} [Sat Oct 8 20:33:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:46.325957 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ff829-200c-4b82-a10f-c6657d2d0447 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:46.377251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d107ef9-2d16-4382-84b1-504eea0a897b None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:46.391205 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:46.412078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395b43f-0506-40b9-9148-6f82306cddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:46.412683 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395b43f-0506-40b9-9148-6f82306cddfc None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:46.412968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395b43f-0506-40b9-9148-6f82306cddfc None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:46.413261 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395b43f-0506-40b9-9148-6f82306cddfc None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:46.413879 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395b43f-0506-40b9-9148-6f82306cddfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:46.414214 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395b43f-0506-40b9-9148-6f82306cddfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:46.415577 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395b43f-0506-40b9-9148-6f82306cddfc None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:46.426638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ff829-200c-4b82-a10f-c6657d2d0447 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:46.427228 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 257/509] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:46.428031 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395b43f-0506-40b9-9148-6f82306cddfc None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:46.445691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:46.464481 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebce12d-5010-4a92-ad09-c95142d1ba97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:46.465078 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebce12d-5010-4a92-ad09-c95142d1ba97 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:46.465357 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebce12d-5010-4a92-ad09-c95142d1ba97 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:46.465631 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebce12d-5010-4a92-ad09-c95142d1ba97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:46.524302 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395b43f-0506-40b9-9148-6f82306cddfc None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:46.531749 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebce12d-5010-4a92-ad09-c95142d1ba97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:46.533203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebce12d-5010-4a92-ad09-c95142d1ba97 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:46.558534 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61958f7d-4a5f-4ed5-86f7-e015671e16cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:46.559218 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61958f7d-4a5f-4ed5-86f7-e015671e16cc None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:46.559502 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61958f7d-4a5f-4ed5-86f7-e015671e16cc None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:46.559773 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61958f7d-4a5f-4ed5-86f7-e015671e16cc None admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:46.560480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61958f7d-4a5f-4ed5-86f7-e015671e16cc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:46.560787 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61958f7d-4a5f-4ed5-86f7-e015671e16cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:46.562221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61958f7d-4a5f-4ed5-86f7-e015671e16cc None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:46.580387 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 258/510] 10.222.0.36 () {56 vars in 1139 bytes} [Sat Oct 8 20:33:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:46.581796 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61958f7d-4a5f-4ed5-86f7-e015671e16cc None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:46.594982 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:46.632521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 253/511] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:46.633344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebce12d-5010-4a92-ad09-c95142d1ba97 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:46.656471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:46.681397 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61958f7d-4a5f-4ed5-86f7-e015671e16cc None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:46.714242 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf393be-712b-41ca-ba51-b6871f2f1b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:46.714842 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf393be-712b-41ca-ba51-b6871f2f1b50 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:46.715117 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf393be-712b-41ca-ba51-b6871f2f1b50 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:46.715386 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf393be-712b-41ca-ba51-b6871f2f1b50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:46.738151 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebce12d-5010-4a92-ad09-c95142d1ba97 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:46.770107 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaa365-2f48-4168-9c50-25c49a1eb5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:46.770727 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaa365-2f48-4168-9c50-25c49a1eb5be None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:46.771003 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaa365-2f48-4168-9c50-25c49a1eb5be None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:46.771274 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaa365-2f48-4168-9c50-25c49a1eb5be None admin] PATH_INFO: `/v3/projects/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:46.777787 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaa365-2f48-4168-9c50-25c49a1eb5be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:46.779199 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaa365-2f48-4168-9c50-25c49a1eb5be None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:46.780643 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf393be-712b-41ca-ba51-b6871f2f1b50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:46.782085 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf393be-712b-41ca-ba51-b6871f2f1b50 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:46.791300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-f6eaa365-2f48-4168-9c50-25c49a1eb5be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:46.791300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:46.791300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:46.791300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:46.791300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:46.791300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:46.791300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:46.791300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:46.791300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:46.791300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:46.791300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:46.791300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:46.791300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:33:46.791300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:33:46.791300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:46.792177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:46.793032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:33:46.793032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:33:46.793032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:33:46.793032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:33:46.793032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:33:46.793032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:33:46.793032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:46.793032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:46.793032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 254/512] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:46.793511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaa365-2f48-4168-9c50-25c49a1eb5be None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:46.824473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:46.858384 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:46.884778 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 259/513] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:46.885649 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf393be-712b-41ca-ba51-b6871f2f1b50 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:46.900988 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaa365-2f48-4168-9c50-25c49a1eb5be None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:46.934354 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10689afc-6658-4801-9f1f-32742874771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:46.934883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10689afc-6658-4801-9f1f-32742874771c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:46.935163 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10689afc-6658-4801-9f1f-32742874771c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:46.935432 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10689afc-6658-4801-9f1f-32742874771c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:46.980053 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf393be-712b-41ca-ba51-b6871f2f1b50 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:47.000516 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10689afc-6658-4801-9f1f-32742874771c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:47.001972 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10689afc-6658-4801-9f1f-32742874771c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:47.013288 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64905f-9d86-467d-bd7c-5ee4b7557393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:47.013938 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64905f-9d86-467d-bd7c-5ee4b7557393 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:47.014220 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64905f-9d86-467d-bd7c-5ee4b7557393 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:47.014490 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64905f-9d86-467d-bd7c-5ee4b7557393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:47.024172 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64905f-9d86-467d-bd7c-5ee4b7557393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:47.025662 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64905f-9d86-467d-bd7c-5ee4b7557393 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:47.027451 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-5f64905f-9d86-467d-bd7c-5ee4b7557393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:47.041430 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:47.042524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:47.043398 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:47.043398 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:47.043398 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:47.043398 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 260/514] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:47.043612 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64905f-9d86-467d-bd7c-5ee4b7557393 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:47.075789 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:47.106232 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 255/515] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:47.107368 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10689afc-6658-4801-9f1f-32742874771c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:47.147395 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64905f-9d86-467d-bd7c-5ee4b7557393 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:47.179250 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccd59c-153a-4496-a977-cfed021f9796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:47.179848 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccd59c-153a-4496-a977-cfed021f9796 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:47.180131 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccd59c-153a-4496-a977-cfed021f9796 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:47.180398 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccd59c-153a-4496-a977-cfed021f9796 None admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:47.181077 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccd59c-153a-4496-a977-cfed021f9796 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:47.181380 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccd59c-153a-4496-a977-cfed021f9796 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:47.182827 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccd59c-153a-4496-a977-cfed021f9796 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:47.199848 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 261/516] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:33:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:47.200747 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccd59c-153a-4496-a977-cfed021f9796 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:47.203763 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10689afc-6658-4801-9f1f-32742874771c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:47.228893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:47.238828 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374d51e-9438-4eef-9441-70918f699ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:47.239449 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374d51e-9438-4eef-9441-70918f699ddc None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:47.239735 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374d51e-9438-4eef-9441-70918f699ddc None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:47.240010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374d51e-9438-4eef-9441-70918f699ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:47.249658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374d51e-9438-4eef-9441-70918f699ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:47.251125 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374d51e-9438-4eef-9441-70918f699ddc None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-f374d51e-9438-4eef-9441-70918f699ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:47.265344 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:47.266435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:47.267499 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:47.267499 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:47.267499 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:47.267499 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 256/517] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:47.267499 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374d51e-9438-4eef-9441-70918f699ddc None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:47.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:47.304025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccd59c-153a-4496-a977-cfed021f9796 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:47.337192 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c03ed1-2959-4dac-b89e-715b2512e1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:47.337789 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c03ed1-2959-4dac-b89e-715b2512e1e3 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:47.338097 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c03ed1-2959-4dac-b89e-715b2512e1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:47.338368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c03ed1-2959-4dac-b89e-715b2512e1e3 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:47.338996 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c03ed1-2959-4dac-b89e-715b2512e1e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:47.339295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c03ed1-2959-4dac-b89e-715b2512e1e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:47.340626 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c03ed1-2959-4dac-b89e-715b2512e1e3 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:47.352062 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 262/518] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:47.352832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c03ed1-2959-4dac-b89e-715b2512e1e3 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:47.369354 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374d51e-9438-4eef-9441-70918f699ddc None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:47.401956 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3647705-9bef-4ed4-a391-dc8d105ed994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:47.402566 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3647705-9bef-4ed4-a391-dc8d105ed994 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:47.402841 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3647705-9bef-4ed4-a391-dc8d105ed994 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:47.403116 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3647705-9bef-4ed4-a391-dc8d105ed994 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:47.413673 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3647705-9bef-4ed4-a391-dc8d105ed994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:47.415151 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3647705-9bef-4ed4-a391-dc8d105ed994 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-c3647705-9bef-4ed4-a391-dc8d105ed994 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:47.428739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:47.429818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:47.430846 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:47.430846 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:47.430846 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:47.430846 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 257/519] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:47.431899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3647705-9bef-4ed4-a391-dc8d105ed994 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:47.451365 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c03ed1-2959-4dac-b89e-715b2512e1e3 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:47.461751 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:47.484424 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2034a-3847-4162-81d4-bd84a11056d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:47.485020 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2034a-3847-4162-81d4-bd84a11056d6 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:47.485292 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2034a-3847-4162-81d4-bd84a11056d6 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:47.485562 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2034a-3847-4162-81d4-bd84a11056d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:47.486300 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2034a-3847-4162-81d4-bd84a11056d6 None admin] RBAC: Adding query filter params (role.id=b849f9edba724fe5a0d7d1e8da249400, scope.project.id=bac7915cef1d4e3288a30fd015fcce50, user.id=017db52cc36f4bdb9448afe74edab753) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:47.486603 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2034a-3847-4162-81d4-bd84a11056d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:47.488575 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2034a-3847-4162-81d4-bd84a11056d6 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:47.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 263/520] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:33:47 2022] GET /identity/v3/role_assignments?user.id=017db52cc36f4bdb9448afe74edab753&scope.project.id=bac7915cef1d4e3288a30fd015fcce50&role.id=b849f9edba724fe5a0d7d1e8da249400 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:47.494438 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2034a-3847-4162-81d4-bd84a11056d6 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:47.510466 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:47.541561 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3647705-9bef-4ed4-a391-dc8d105ed994 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:47.579093 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17faf976-c374-41a7-a8e5-9200be2e1ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:47.579971 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faf976-c374-41a7-a8e5-9200be2e1ecd None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:47.580252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faf976-c374-41a7-a8e5-9200be2e1ecd None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:47.580525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faf976-c374-41a7-a8e5-9200be2e1ecd None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:47.581397 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17faf976-c374-41a7-a8e5-9200be2e1ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:47.581703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17faf976-c374-41a7-a8e5-9200be2e1ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:47.583146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17faf976-c374-41a7-a8e5-9200be2e1ecd None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:47.600874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 258/521] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:47.601815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17faf976-c374-41a7-a8e5-9200be2e1ecd None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:47.604975 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2034a-3847-4162-81d4-bd84a11056d6 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:47.645309 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2511c12-ecb4-43b8-b983-48c59614d5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:47.646008 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2511c12-ecb4-43b8-b983-48c59614d5d5 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:47.646292 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2511c12-ecb4-43b8-b983-48c59614d5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:47.647195 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2511c12-ecb4-43b8-b983-48c59614d5d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:47.654041 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2511c12-ecb4-43b8-b983-48c59614d5d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:47.655520 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2511c12-ecb4-43b8-b983-48c59614d5d5 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:47.670523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-f2511c12-ecb4-43b8-b983-48c59614d5d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:47.670523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:47.670523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:47.670523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:47.670523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:47.670523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:47.670523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:47.670523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:47.670523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:47.670523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:47.670523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:47.670523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:47.670523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:33:47.670523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:33:47.670523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:47.671474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:47.672315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:33:47.672315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:33:47.672315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:33:47.672315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:33:47.672315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:33:47.672315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:33:47.672315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:47.672315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:47.672315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 264/522] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:47.672805 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2511c12-ecb4-43b8-b983-48c59614d5d5 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:47.716910 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:47.736803 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17faf976-c374-41a7-a8e5-9200be2e1ecd None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:47.758387 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:47.773165 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20542d7-6d62-4839-b94b-490331c4c82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:47.774026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20542d7-6d62-4839-b94b-490331c4c82e None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:47.774313 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20542d7-6d62-4839-b94b-490331c4c82e None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:47.774605 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20542d7-6d62-4839-b94b-490331c4c82e None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:47.775245 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20542d7-6d62-4839-b94b-490331c4c82e None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:47.775546 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20542d7-6d62-4839-b94b-490331c4c82e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:47.776919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20542d7-6d62-4839-b94b-490331c4c82e None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:47.788367 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 259/523] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:47.789177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20542d7-6d62-4839-b94b-490331c4c82e None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:47.797466 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2511c12-ecb4-43b8-b983-48c59614d5d5 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:47.835237 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a3799-ad1e-44d1-b547-4cfd310b9504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:47.836244 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3799-ad1e-44d1-b547-4cfd310b9504 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:47.836825 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3799-ad1e-44d1-b547-4cfd310b9504 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:47.837172 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3799-ad1e-44d1-b547-4cfd310b9504 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:47.844439 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a3799-ad1e-44d1-b547-4cfd310b9504 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:47.846196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a3799-ad1e-44d1-b547-4cfd310b9504 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:47.858713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-ce2a3799-ad1e-44d1-b547-4cfd310b9504 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:47.858713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:47.858713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:47.858713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:47.858713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:47.858713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:47.858713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:47.858713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:47.858713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:47.858713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:47.858713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:47.858713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:47.858713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:33:47.858713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:33:47.858713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:47.859913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:47.866335 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:33:47.866335 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:33:47.866335 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:33:47.866335 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:33:47.866335 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:33:47.866335 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:33:47.866335 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:47.866335 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:47.866335 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 265/524] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:47.866335 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a3799-ad1e-44d1-b547-4cfd310b9504 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:47.898537 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20542d7-6d62-4839-b94b-490331c4c82e None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:47.933561 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4b7ad-f61f-441b-a61a-869042d3c270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:47.934308 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4b7ad-f61f-441b-a61a-869042d3c270 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:47.934658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4b7ad-f61f-441b-a61a-869042d3c270 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:47.935002 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4b7ad-f61f-441b-a61a-869042d3c270 None admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:47.935764 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4b7ad-f61f-441b-a61a-869042d3c270 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:47.936137 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4b7ad-f61f-441b-a61a-869042d3c270 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:47.937640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4b7ad-f61f-441b-a61a-869042d3c270 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:47.960944 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 260/525] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:33:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:47.960944 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4b7ad-f61f-441b-a61a-869042d3c270 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:47.970996 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:47.979868 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a3799-ad1e-44d1-b547-4cfd310b9504 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:48.013798 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:48.020794 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2242079-448a-4ca8-a6f7-0c6560f851e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:48.021960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2242079-448a-4ca8-a6f7-0c6560f851e6 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:48.022316 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2242079-448a-4ca8-a6f7-0c6560f851e6 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:48.022968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2242079-448a-4ca8-a6f7-0c6560f851e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:48.031112 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2242079-448a-4ca8-a6f7-0c6560f851e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:48.032745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2242079-448a-4ca8-a6f7-0c6560f851e6 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:48.048058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-f2242079-448a-4ca8-a6f7-0c6560f851e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:48.048058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:48.048058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:48.048058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:48.048058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:48.048058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:48.048058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:48.048058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:48.048058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:48.048058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:48.048058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:48.048058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:48.048058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:33:48.048058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:33:48.048058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:48.049196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:48.055251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:33:48.055251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:33:48.055251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:33:48.055251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:33:48.055251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:33:48.055251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:33:48.055251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:48.055251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:48.055251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 266/526] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:48.056594 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2242079-448a-4ca8-a6f7-0c6560f851e6 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:48.076910 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4b7ad-f61f-441b-a61a-869042d3c270 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:48.113690 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee8b8f-a478-4ea8-847b-fa2059aa4196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:48.114245 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee8b8f-a478-4ea8-847b-fa2059aa4196 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:48.114525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee8b8f-a478-4ea8-847b-fa2059aa4196 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:48.114796 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee8b8f-a478-4ea8-847b-fa2059aa4196 None admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:48.115481 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee8b8f-a478-4ea8-847b-fa2059aa4196 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:48.115801 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee8b8f-a478-4ea8-847b-fa2059aa4196 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:48.117189 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee8b8f-a478-4ea8-847b-fa2059aa4196 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:48.133279 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 261/527] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:33:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:48.133279 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee8b8f-a478-4ea8-847b-fa2059aa4196 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:48.168038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2242079-448a-4ca8-a6f7-0c6560f851e6 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:48.203818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5363069-4d09-47dc-abb1-c92250f8ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:48.204753 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5363069-4d09-47dc-abb1-c92250f8ed2a None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:48.205406 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:48.205869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5363069-4d09-47dc-abb1-c92250f8ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:48.207303 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5363069-4d09-47dc-abb1-c92250f8ed2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:48.208232 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5363069-4d09-47dc-abb1-c92250f8ed2a None admin] RBAC: Adding query filter params (role.id=b849f9edba724fe5a0d7d1e8da249400, scope.project.id=bac7915cef1d4e3288a30fd015fcce50, user.id=7210700b41444499b0a6cfe978445247) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:48.208721 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5363069-4d09-47dc-abb1-c92250f8ed2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:48.210486 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5363069-4d09-47dc-abb1-c92250f8ed2a None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:48.216658 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 267/528] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:33:48 2022] GET /identity/v3/role_assignments?user.id=7210700b41444499b0a6cfe978445247&scope.project.id=bac7915cef1d4e3288a30fd015fcce50&role.id=b849f9edba724fe5a0d7d1e8da249400 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:48.217458 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5363069-4d09-47dc-abb1-c92250f8ed2a None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:48.256116 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee8b8f-a478-4ea8-847b-fa2059aa4196 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:48.296617 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:48.304570 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd57369-0f14-4d31-a51c-e1a97b0b3dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:48.305221 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd57369-0f14-4d31-a51c-e1a97b0b3dba None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:48.305503 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd57369-0f14-4d31-a51c-e1a97b0b3dba None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:48.305777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd57369-0f14-4d31-a51c-e1a97b0b3dba None admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:48.306814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd57369-0f14-4d31-a51c-e1a97b0b3dba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:48.307131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd57369-0f14-4d31-a51c-e1a97b0b3dba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:48.308884 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd57369-0f14-4d31-a51c-e1a97b0b3dba None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:48.330494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 262/529] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:48.332077 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd57369-0f14-4d31-a51c-e1a97b0b3dba None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:48.358772 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5363069-4d09-47dc-abb1-c92250f8ed2a None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:48.395562 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c244af-8b57-4caf-b241-667cfa45ed76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:48.396130 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c244af-8b57-4caf-b241-667cfa45ed76 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:48.396412 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c244af-8b57-4caf-b241-667cfa45ed76 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:48.396691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c244af-8b57-4caf-b241-667cfa45ed76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:48.397504 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c244af-8b57-4caf-b241-667cfa45ed76 None admin] RBAC: Adding query filter params (role.id=b849f9edba724fe5a0d7d1e8da249400, scope.project.id=bac7915cef1d4e3288a30fd015fcce50, user.id=e2efb666066f4caaa7353656984b5bcd) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:48.398017 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c244af-8b57-4caf-b241-667cfa45ed76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:48.399465 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c244af-8b57-4caf-b241-667cfa45ed76 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:48.414161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 268/530] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:33:48 2022] GET /identity/v3/role_assignments?user.id=e2efb666066f4caaa7353656984b5bcd&scope.project.id=bac7915cef1d4e3288a30fd015fcce50&role.id=b849f9edba724fe5a0d7d1e8da249400 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:48.458368 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd57369-0f14-4d31-a51c-e1a97b0b3dba None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:48.494285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:48.501227 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea07049-5131-410f-baab-e8dd637f6f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:48.502286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea07049-5131-410f-baab-e8dd637f6f9f None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:48.503378 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea07049-5131-410f-baab-e8dd637f6f9f None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:48.504355 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea07049-5131-410f-baab-e8dd637f6f9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:48.505385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea07049-5131-410f-baab-e8dd637f6f9f None admin] RBAC: Adding query filter params (role.id=b849f9edba724fe5a0d7d1e8da249400, scope.project.id=bac7915cef1d4e3288a30fd015fcce50, user.id=98b1f2e36ec948eabeb7c0c1bdf87216) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:48.505967 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea07049-5131-410f-baab-e8dd637f6f9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:48.507872 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea07049-5131-410f-baab-e8dd637f6f9f None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:48.514999 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 263/531] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:33:48 2022] GET /identity/v3/role_assignments?user.id=98b1f2e36ec948eabeb7c0c1bdf87216&scope.project.id=bac7915cef1d4e3288a30fd015fcce50&role.id=b849f9edba724fe5a0d7d1e8da249400 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:49.928893 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398bfdb-101f-43ba-94cf-769b0b7846b5 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:49.929410 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398bfdb-101f-43ba-94cf-769b0b7846b5 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:49.929410 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398bfdb-101f-43ba-94cf-769b0b7846b5 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:49.931011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 269/532] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:49.936357 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57615e1c-70c4-44fa-91fb-3069318e69a2 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:49.936771 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57615e1c-70c4-44fa-91fb-3069318e69a2 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:49.936948 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57615e1c-70c4-44fa-91fb-3069318e69a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:49.956059 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-57615e1c-70c4-44fa-91fb-3069318e69a2 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:49.957409 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-57615e1c-70c4-44fa-91fb-3069318e69a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:50.026900 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 264/533] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:50.351852 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398bfdb-101f-43ba-94cf-769b0b7846b5 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:50.465542 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398bfdb-101f-43ba-94cf-769b0b7846b5 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:50.487312 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:50.501685 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8192c-a46e-42e5-bac3-9dab8b6ca05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:50.502339 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8192c-a46e-42e5-bac3-9dab8b6ca05e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:50.503231 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8192c-a46e-42e5-bac3-9dab8b6ca05e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:50.503479 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8192c-a46e-42e5-bac3-9dab8b6ca05e None admin] PATH_INFO: `/v3/roles/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:50.514514 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8192c-a46e-42e5-bac3-9dab8b6ca05e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-efd8192c-a46e-42e5-bac3-9dab8b6ca05e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:50.519620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:50.520540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:50.521389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:50.521389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:50.521389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:50.521389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:50.521389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:50.521389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:50.521389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:50.521389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:50.521389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:50.521389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:50.521389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:50.521389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:50.521389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 270/534] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:33:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:50.526635 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57615e1c-70c4-44fa-91fb-3069318e69a2 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:50.639072 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57615e1c-70c4-44fa-91fb-3069318e69a2 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:50.663374 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:50.676065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbb643-1790-44aa-b085-c598a1b120d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:50.676711 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbb643-1790-44aa-b085-c598a1b120d3 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:50.677075 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbb643-1790-44aa-b085-c598a1b120d3 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:50.677393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbb643-1790-44aa-b085-c598a1b120d3 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:50.678215 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbb643-1790-44aa-b085-c598a1b120d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:50.678589 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbb643-1790-44aa-b085-c598a1b120d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:50.680075 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbb643-1790-44aa-b085-c598a1b120d3 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:50.689499 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 265/535] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Oct 8 20:33:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:50.695504 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8192c-a46e-42e5-bac3-9dab8b6ca05e None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:50.736389 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ebd5d-8d61-49fb-bc17-77ab290129e5 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:50.736697 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ebd5d-8d61-49fb-bc17-77ab290129e5 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:50.736979 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ebd5d-8d61-49fb-bc17-77ab290129e5 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:50.738707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 266/536] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:50.743725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab6b73-c0f8-4729-804d-40c48a4640d8 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:50.744006 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab6b73-c0f8-4729-804d-40c48a4640d8 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:50.744284 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab6b73-c0f8-4729-804d-40c48a4640d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:50.763046 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-acab6b73-c0f8-4729-804d-40c48a4640d8 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:50.764270 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-acab6b73-c0f8-4729-804d-40c48a4640d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:50.817388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8192c-a46e-42e5-bac3-9dab8b6ca05e None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:50.850153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 267/537] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:50.856177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3833c6-0b3d-47c2-b2d2-6f8dc82ad841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:50.856799 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3833c6-0b3d-47c2-b2d2-6f8dc82ad841 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:50.857075 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3833c6-0b3d-47c2-b2d2-6f8dc82ad841 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:50.857343 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3833c6-0b3d-47c2-b2d2-6f8dc82ad841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:50.870295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3833c6-0b3d-47c2-b2d2-6f8dc82ad841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:50.871741 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3833c6-0b3d-47c2-b2d2-6f8dc82ad841 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:50.883038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865322e-8be4-456b-b73e-02abe5ffdf32 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:50.883383 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865322e-8be4-456b-b73e-02abe5ffdf32 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:50.883665 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865322e-8be4-456b-b73e-02abe5ffdf32 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:50.885244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 268/538] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-ef3833c6-0b3d-47c2-b2d2-6f8dc82ad841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:50.888511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:50.889410 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:50.889410 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:50.889410 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:50.889410 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 271/539] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:50.891204 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff45b7-034b-4660-ad99-d6b037d92fd0 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:50.891692 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff45b7-034b-4660-ad99-d6b037d92fd0 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:50.892172 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff45b7-034b-4660-ad99-d6b037d92fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:50.894804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3833c6-0b3d-47c2-b2d2-6f8dc82ad841 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:50.913625 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-16ff45b7-034b-4660-ad99-d6b037d92fd0 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:50.915299 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-16ff45b7-034b-4660-ad99-d6b037d92fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:50.929003 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:50.989170 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 269/540] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:51.007935 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3833c6-0b3d-47c2-b2d2-6f8dc82ad841 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:51.043634 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b4631-28da-4da1-92e3-6ab2b6449e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:51.044251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b4631-28da-4da1-92e3-6ab2b6449e54 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:51.044533 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b4631-28da-4da1-92e3-6ab2b6449e54 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:51.044810 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b4631-28da-4da1-92e3-6ab2b6449e54 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:51.045450 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b4631-28da-4da1-92e3-6ab2b6449e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:51.045754 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b4631-28da-4da1-92e3-6ab2b6449e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:51.047184 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b4631-28da-4da1-92e3-6ab2b6449e54 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:51.055321 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80bb7-28a9-4b06-b50a-9ebbdf880879 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:51.058714 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80bb7-28a9-4b06-b50a-9ebbdf880879 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:51.059300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80bb7-28a9-4b06-b50a-9ebbdf880879 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:51.060701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 272/541] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:51.065071 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 270/542] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:33:51.066357 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f80bb7-28a9-4b06-b50a-9ebbdf880879 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:51.066466 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c90bf-740a-4bb1-b89c-fb479ddeeae6 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:51.066685 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c90bf-740a-4bb1-b89c-fb479ddeeae6 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:51.066966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c90bf-740a-4bb1-b89c-fb479ddeeae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:51.086551 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-834c90bf-740a-4bb1-b89c-fb479ddeeae6 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:51.087914 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-834c90bf-740a-4bb1-b89c-fb479ddeeae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:51.122379 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:51.166025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 273/543] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:51.196200 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f80bb7-28a9-4b06-b50a-9ebbdf880879 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:51.203483 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c90bf-740a-4bb1-b89c-fb479ddeeae6 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:51.235119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:51.238395 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29af17-603a-481f-9a2b-287a2040ef80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:51.239555 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29af17-603a-481f-9a2b-287a2040ef80 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:51.239898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29af17-603a-481f-9a2b-287a2040ef80 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:51.240177 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29af17-603a-481f-9a2b-287a2040ef80 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:51.250283 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29af17-603a-481f-9a2b-287a2040ef80 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:51.251855 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29af17-603a-481f-9a2b-287a2040ef80 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-aa29af17-603a-481f-9a2b-287a2040ef80 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:33:51.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:51.267899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:51.269233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:51.269233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:51.269233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:33:51.269233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:33:51.269233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:33:51.269233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:33:51.269233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:33:51.269233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:33:51.269233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:33:51.269233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:51.273809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 271/544] 10.222.0.36 () {56 vars in 1093 bytes} [Sat Oct 8 20:33:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:51.275106 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29af17-603a-481f-9a2b-287a2040ef80 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:51.332521 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c90bf-740a-4bb1-b89c-fb479ddeeae6 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:51.370554 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813adb-bb5b-456d-9ea3-d99224206de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:51.371187 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813adb-bb5b-456d-9ea3-d99224206de4 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:51.371467 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813adb-bb5b-456d-9ea3-d99224206de4 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:51.371741 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813adb-bb5b-456d-9ea3-d99224206de4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:51.381672 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29af17-603a-481f-9a2b-287a2040ef80 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:51.382227 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80813adb-bb5b-456d-9ea3-d99224206de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-80813adb-bb5b-456d-9ea3-d99224206de4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:51.387009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:51.387921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:51.388739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:51.388739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:51.388739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:51.388739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:51.388739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:51.388739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:51.388739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:51.388739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:51.388739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:51.388739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:51.388739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:51.388739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:51.388739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 274/545] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:33:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:33:51.390019 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813adb-bb5b-456d-9ea3-d99224206de4 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:51.392788 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:51.424296 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a819b8-0661-414e-aa71-3706240d06f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:51.425661 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a819b8-0661-414e-aa71-3706240d06f1 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:51.425971 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a819b8-0661-414e-aa71-3706240d06f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:51.426251 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a819b8-0661-414e-aa71-3706240d06f1 None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:51.426968 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a819b8-0661-414e-aa71-3706240d06f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:51.427273 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a819b8-0661-414e-aa71-3706240d06f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:51.428687 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a819b8-0661-414e-aa71-3706240d06f1 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:51.445802 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 272/546] 10.222.0.36 () {56 vars in 1133 bytes} [Sat Oct 8 20:33:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:51.446644 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a819b8-0661-414e-aa71-3706240d06f1 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:51.487169 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:51.506746 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813adb-bb5b-456d-9ea3-d99224206de4 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:51.540570 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6d01f-5397-4af2-92bb-83ff6c9be235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:51.541201 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6d01f-5397-4af2-92bb-83ff6c9be235 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:51.541478 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6d01f-5397-4af2-92bb-83ff6c9be235 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:51.541752 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6d01f-5397-4af2-92bb-83ff6c9be235 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:51.546609 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a819b8-0661-414e-aa71-3706240d06f1 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:51.551996 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6d01f-5397-4af2-92bb-83ff6c9be235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-88d6d01f-5397-4af2-92bb-83ff6c9be235 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:51.556745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:51.557642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:51.558496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:51.558496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:51.558496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:51.558496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:51.558496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:51.558496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:51.558496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:51.558496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:51.558496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:51.558496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:51.558496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:51.558496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:51.558496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 275/547] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:33:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:51.559158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6d01f-5397-4af2-92bb-83ff6c9be235 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:51.582811 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb9b86-8e05-49de-a898-be94e7579c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:51.583406 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb9b86-8e05-49de-a898-be94e7579c80 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:51.583687 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb9b86-8e05-49de-a898-be94e7579c80 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:51.584037 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb9b86-8e05-49de-a898-be94e7579c80 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:51.584684 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb9b86-8e05-49de-a898-be94e7579c80 None admin] RBAC: Adding query filter params (name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:51.584987 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb9b86-8e05-49de-a898-be94e7579c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:51.586389 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb9b86-8e05-49de-a898-be94e7579c80 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:51.593863 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 273/548] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Oct 8 20:33:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:51.594654 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb9b86-8e05-49de-a898-be94e7579c80 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:51.622232 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:51.656810 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6d01f-5397-4af2-92bb-83ff6c9be235 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:51.690588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0364f2-26e8-4e2a-9e1c-1d9209fb68a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:51.691136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0364f2-26e8-4e2a-9e1c-1d9209fb68a5 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:51.691471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0364f2-26e8-4e2a-9e1c-1d9209fb68a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:51.691752 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0364f2-26e8-4e2a-9e1c-1d9209fb68a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:51.694503 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb9b86-8e05-49de-a898-be94e7579c80 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:51.701280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0364f2-26e8-4e2a-9e1c-1d9209fb68a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:51.702729 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0364f2-26e8-4e2a-9e1c-1d9209fb68a5 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:51.704392 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-cd0364f2-26e8-4e2a-9e1c-1d9209fb68a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:51.719038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:51.720000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:51.721257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:51.721257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:51.721257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:51.721257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 276/549] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:51.721257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0364f2-26e8-4e2a-9e1c-1d9209fb68a5 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:51.730072 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e62443-4c20-4ac3-a755-c303ba521760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:51.730680 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e62443-4c20-4ac3-a755-c303ba521760 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:51.730961 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e62443-4c20-4ac3-a755-c303ba521760 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:51.731232 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e62443-4c20-4ac3-a755-c303ba521760 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:51.741412 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e62443-4c20-4ac3-a755-c303ba521760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-f8e62443-4c20-4ac3-a755-c303ba521760 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:51.747209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:51.748121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:51.753992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:51.753992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:51.753992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:51.753992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:51.753992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:51.753992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:51.753992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:51.753992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:51.753992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:51.753992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:51.753992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:51.753992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:51.753992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 274/550] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:33:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:51.753992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e62443-4c20-4ac3-a755-c303ba521760 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:51.820559 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0364f2-26e8-4e2a-9e1c-1d9209fb68a5 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:51.838064 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:51.852605 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e62443-4c20-4ac3-a755-c303ba521760 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:51.854047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a644af-2860-49d0-b53a-78ca81450344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:51.854659 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a644af-2860-49d0-b53a-78ca81450344 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:51.854942 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a644af-2860-49d0-b53a-78ca81450344 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:51.855217 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a644af-2860-49d0-b53a-78ca81450344 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:51.855870 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a644af-2860-49d0-b53a-78ca81450344 None admin] RBAC: Adding query filter params (name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:51.856177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a644af-2860-49d0-b53a-78ca81450344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:51.857534 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a644af-2860-49d0-b53a-78ca81450344 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:51.866428 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 277/551] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Oct 8 20:33:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:51.867214 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a644af-2860-49d0-b53a-78ca81450344 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:51.889287 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a259325-78b7-4fd6-8a5c-31e54262c01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:51.889941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a259325-78b7-4fd6-8a5c-31e54262c01c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:51.890223 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a259325-78b7-4fd6-8a5c-31e54262c01c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:51.890495 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a259325-78b7-4fd6-8a5c-31e54262c01c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:51.901245 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a259325-78b7-4fd6-8a5c-31e54262c01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:51.902723 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a259325-78b7-4fd6-8a5c-31e54262c01c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-1a259325-78b7-4fd6-8a5c-31e54262c01c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:51.916385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:51.917473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:51.918473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:51.918473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:51.918473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:51.918473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 275/552] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:51.918473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a259325-78b7-4fd6-8a5c-31e54262c01c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:51.926464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:51.969879 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a644af-2860-49d0-b53a-78ca81450344 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:52.002397 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef1bbc-23bf-4c10-ad4a-9155f79499cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:52.003680 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef1bbc-23bf-4c10-ad4a-9155f79499cd None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:52.003960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef1bbc-23bf-4c10-ad4a-9155f79499cd None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:52.004230 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef1bbc-23bf-4c10-ad4a-9155f79499cd None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:52.004862 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef1bbc-23bf-4c10-ad4a-9155f79499cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:52.005162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef1bbc-23bf-4c10-ad4a-9155f79499cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:52.006566 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef1bbc-23bf-4c10-ad4a-9155f79499cd None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:52.015377 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a259325-78b7-4fd6-8a5c-31e54262c01c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:52.023196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 278/553] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:52.023196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef1bbc-23bf-4c10-ad4a-9155f79499cd None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:52.049858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44131a1-585d-478f-8d85-04fcc85b3e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:52.055797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44131a1-585d-478f-8d85-04fcc85b3e27 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:52.055797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44131a1-585d-478f-8d85-04fcc85b3e27 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:52.055797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44131a1-585d-478f-8d85-04fcc85b3e27 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:52.055797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44131a1-585d-478f-8d85-04fcc85b3e27 None admin] RBAC: Adding query filter params (name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:52.055797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44131a1-585d-478f-8d85-04fcc85b3e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:52.055797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44131a1-585d-478f-8d85-04fcc85b3e27 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:52.059704 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:52.062298 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 276/554] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Oct 8 20:33:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:52.063179 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44131a1-585d-478f-8d85-04fcc85b3e27 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:52.119695 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef1bbc-23bf-4c10-ad4a-9155f79499cd None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:52.135777 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:52.154467 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4dd9c-2904-4a3e-a2e4-405e64e9a956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:52.155090 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4dd9c-2904-4a3e-a2e4-405e64e9a956 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:52.155368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4dd9c-2904-4a3e-a2e4-405e64e9a956 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:52.155636 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4dd9c-2904-4a3e-a2e4-405e64e9a956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:52.161789 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44131a1-585d-478f-8d85-04fcc85b3e27 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:52.165702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4dd9c-2904-4a3e-a2e4-405e64e9a956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:52.167176 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4dd9c-2904-4a3e-a2e4-405e64e9a956 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-dbc4dd9c-2904-4a3e-a2e4-405e64e9a956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:52.182326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:52.183337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:52.184235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:52.184235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:52.184235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:52.184235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 279/555] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:52.184235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4dd9c-2904-4a3e-a2e4-405e64e9a956 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:52.200049 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3489c0-ab18-491b-a285-07130046b7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:52.200656 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3489c0-ab18-491b-a285-07130046b7f6 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:52.200937 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3489c0-ab18-491b-a285-07130046b7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:52.201215 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3489c0-ab18-491b-a285-07130046b7f6 None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:52.201856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3489c0-ab18-491b-a285-07130046b7f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:52.202191 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3489c0-ab18-491b-a285-07130046b7f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:52.203529 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3489c0-ab18-491b-a285-07130046b7f6 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:52.215704 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 277/556] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:52.216480 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3489c0-ab18-491b-a285-07130046b7f6 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:52.273436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:52.283309 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4dd9c-2904-4a3e-a2e4-405e64e9a956 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:52.314450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3489c0-ab18-491b-a285-07130046b7f6 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:52.320083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16ad41-211e-498f-a8ff-f5cf757b3db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:52.320706 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16ad41-211e-498f-a8ff-f5cf757b3db4 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:52.320983 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16ad41-211e-498f-a8ff-f5cf757b3db4 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:52.321251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16ad41-211e-498f-a8ff-f5cf757b3db4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:52.327727 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16ad41-211e-498f-a8ff-f5cf757b3db4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:52.329141 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16ad41-211e-498f-a8ff-f5cf757b3db4 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:52.340818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-8a16ad41-211e-498f-a8ff-f5cf757b3db4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:52.340818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:52.340818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:52.340818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:52.340818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:52.340818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:52.340818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:52.340818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:52.340818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:52.340818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:52.340818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:52.340818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:52.340818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:33:52.340818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:33:52.340818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:52.341845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:52.342808 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:33:52.342808 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:33:52.342808 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:33:52.342808 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:33:52.342808 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:33:52.342808 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:33:52.342808 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:52.342808 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:52.347145 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 280/557] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:52.347877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16ad41-211e-498f-a8ff-f5cf757b3db4 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:52.350032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b8cda-cb3d-4ea1-8cbe-7ea51c0ed1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:52.350826 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b8cda-cb3d-4ea1-8cbe-7ea51c0ed1e3 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:52.351889 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b8cda-cb3d-4ea1-8cbe-7ea51c0ed1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:52.352170 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b8cda-cb3d-4ea1-8cbe-7ea51c0ed1e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:52.362290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b8cda-cb3d-4ea1-8cbe-7ea51c0ed1e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:52.363712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b8cda-cb3d-4ea1-8cbe-7ea51c0ed1e3 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:52.375103 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-3b7b8cda-cb3d-4ea1-8cbe-7ea51c0ed1e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:52.378577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:52.380244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:52.381111 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:52.381111 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:52.381111 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:52.381111 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 278/558] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:52.382882 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b8cda-cb3d-4ea1-8cbe-7ea51c0ed1e3 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:52.447582 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16ad41-211e-498f-a8ff-f5cf757b3db4 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:52.481094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6b517-144b-4552-b3b7-6d7fa10d8978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:52.481695 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6b517-144b-4552-b3b7-6d7fa10d8978 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:52.482006 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6b517-144b-4552-b3b7-6d7fa10d8978 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:52.482281 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6b517-144b-4552-b3b7-6d7fa10d8978 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:52.482912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6b517-144b-4552-b3b7-6d7fa10d8978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:52.483216 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6b517-144b-4552-b3b7-6d7fa10d8978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:52.483319 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b8cda-cb3d-4ea1-8cbe-7ea51c0ed1e3 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:52.484869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6b517-144b-4552-b3b7-6d7fa10d8978 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:52.496520 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:52.496647 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 281/559] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:52.497353 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6b517-144b-4552-b3b7-6d7fa10d8978 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:52.519311 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a085f9-147a-487d-9be7-da9dc524594d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:52.519927 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a085f9-147a-487d-9be7-da9dc524594d None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:52.520208 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a085f9-147a-487d-9be7-da9dc524594d None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:52.520474 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a085f9-147a-487d-9be7-da9dc524594d None admin] PATH_INFO: `/v3/users/glance` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:52.527766 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a085f9-147a-487d-9be7-da9dc524594d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:52.529125 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a085f9-147a-487d-9be7-da9dc524594d None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-f2a085f9-147a-487d-9be7-da9dc524594d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:33:52.540431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:52.541639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:52.542640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:52.542640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:52.542640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:33:52.542640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:33:52.542640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:33:52.542640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:33:52.542640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:33:52.542640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:33:52.542640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 08 20:33:52.542640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:52.542640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 279/560] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:52.542640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a085f9-147a-487d-9be7-da9dc524594d None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:52.588605 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:52.601468 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6b517-144b-4552-b3b7-6d7fa10d8978 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:52.635419 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640188e-6aa6-46c5-9b4d-b2ec46a6a9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:52.636021 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640188e-6aa6-46c5-9b4d-b2ec46a6a9a7 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:52.636304 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640188e-6aa6-46c5-9b4d-b2ec46a6a9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:52.636580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640188e-6aa6-46c5-9b4d-b2ec46a6a9a7 None admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:52.637261 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640188e-6aa6-46c5-9b4d-b2ec46a6a9a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:52.637566 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640188e-6aa6-46c5-9b4d-b2ec46a6a9a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:52.639016 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640188e-6aa6-46c5-9b4d-b2ec46a6a9a7 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:52.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a085f9-147a-487d-9be7-da9dc524594d None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:52.650703 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 282/561] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:33:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:52.651501 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640188e-6aa6-46c5-9b4d-b2ec46a6a9a7 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:52.677083 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4e818-5180-4e19-a473-cc8badca72b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:52.677690 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4e818-5180-4e19-a473-cc8badca72b5 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:52.677999 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4e818-5180-4e19-a473-cc8badca72b5 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:52.678277 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4e818-5180-4e19-a473-cc8badca72b5 None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:52.678918 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4e818-5180-4e19-a473-cc8badca72b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:52.679223 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4e818-5180-4e19-a473-cc8badca72b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:52.680573 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4e818-5180-4e19-a473-cc8badca72b5 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:52.692408 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 280/562] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:52.693191 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4e818-5180-4e19-a473-cc8badca72b5 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:52.722886 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:52.754319 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640188e-6aa6-46c5-9b4d-b2ec46a6a9a7 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:52.786518 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41aa9e-b3da-438e-a466-ac6d277cacfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:52.787075 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41aa9e-b3da-438e-a466-ac6d277cacfe None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:52.787354 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41aa9e-b3da-438e-a466-ac6d277cacfe None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:52.787632 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41aa9e-b3da-438e-a466-ac6d277cacfe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:52.790280 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4e818-5180-4e19-a473-cc8badca72b5 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:52.794818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41aa9e-b3da-438e-a466-ac6d277cacfe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:52.796246 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41aa9e-b3da-438e-a466-ac6d277cacfe None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-1c41aa9e-b3da-438e-a466-ac6d277cacfe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:33:52.807493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:52.808567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:52.809536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:52.809536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:52.809536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:33:52.809536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:33:52.809536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:33:52.809536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:33:52.809536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:33:52.809536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:33:52.809536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:33:52.809536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:52.809536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 283/563] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:52.809536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41aa9e-b3da-438e-a466-ac6d277cacfe None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:52.820133 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:52.832018 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc3ffe-62fe-4311-94d7-375a9750523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:52.832619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc3ffe-62fe-4311-94d7-375a9750523f None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:52.832892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc3ffe-62fe-4311-94d7-375a9750523f None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:52.833161 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc3ffe-62fe-4311-94d7-375a9750523f None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:52.833875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc3ffe-62fe-4311-94d7-375a9750523f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:52.834203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc3ffe-62fe-4311-94d7-375a9750523f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:52.835614 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc3ffe-62fe-4311-94d7-375a9750523f None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:52.853343 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 281/564] 10.222.0.36 () {56 vars in 1137 bytes} [Sat Oct 8 20:33:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:52.854182 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc3ffe-62fe-4311-94d7-375a9750523f None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:52.908436 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41aa9e-b3da-438e-a466-ac6d277cacfe None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:52.941438 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:52.942760 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d653223-ba2c-4c0c-b4a8-411be978b1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:52.943710 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d653223-ba2c-4c0c-b4a8-411be978b1aa None admin] REQUEST_METHOD: `PUT` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:52.943895 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d653223-ba2c-4c0c-b4a8-411be978b1aa None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:52.944247 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d653223-ba2c-4c0c-b4a8-411be978b1aa None admin] PATH_INFO: `/v3/projects/bac7915cef1d4e3288a30fd015fcce50/users/017db52cc36f4bdb9448afe74edab753/roles/b849f9edba724fe5a0d7d1e8da249400` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:52.951534 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc3ffe-62fe-4311-94d7-375a9750523f None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:52.958557 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d653223-ba2c-4c0c-b4a8-411be978b1aa None admin] RBAC: Authorizing `identity:create_grant(project_id=bac7915cef1d4e3288a30fd015fcce50, user_id=017db52cc36f4bdb9448afe74edab753, role_id=b849f9edba724fe5a0d7d1e8da249400)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:52.959970 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d653223-ba2c-4c0c-b4a8-411be978b1aa None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:52.972627 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 284/565] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:33:52 2022] PUT /identity/v3/projects/bac7915cef1d4e3288a30fd015fcce50/users/017db52cc36f4bdb9448afe74edab753/roles/b849f9edba724fe5a0d7d1e8da249400 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:33:52.973496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d653223-ba2c-4c0c-b4a8-411be978b1aa None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:52.988619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eccaa-3bdd-4857-ac28-64f979423725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:52.989276 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eccaa-3bdd-4857-ac28-64f979423725 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:52.989562 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eccaa-3bdd-4857-ac28-64f979423725 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:52.989832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eccaa-3bdd-4857-ac28-64f979423725 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:52.997866 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4eccaa-3bdd-4857-ac28-64f979423725 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:52.999414 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4eccaa-3bdd-4857-ac28-64f979423725 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-9d4eccaa-3bdd-4857-ac28-64f979423725 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:33:53.013026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:53.014092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:53.015062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:53.015062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:53.015062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:33:53.015062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:33:53.015062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:33:53.015062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:33:53.015062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:33:53.015062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:33:53.015062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 08 20:33:53.015062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:53.015062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 282/566] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:33:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:53.015062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eccaa-3bdd-4857-ac28-64f979423725 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:53.047315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:53.100984 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d653223-ba2c-4c0c-b4a8-411be978b1aa None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:53.138203 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbed25-a207-43b3-90f1-fbb647c36af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:53.138824 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbed25-a207-43b3-90f1-fbb647c36af5 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:53.139031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eccaa-3bdd-4857-ac28-64f979423725 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:53.139151 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbed25-a207-43b3-90f1-fbb647c36af5 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:53.139374 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbed25-a207-43b3-90f1-fbb647c36af5 None admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:53.140132 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbed25-a207-43b3-90f1-fbb647c36af5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:53.140446 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbed25-a207-43b3-90f1-fbb647c36af5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:53.141936 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbed25-a207-43b3-90f1-fbb647c36af5 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:53.161009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 285/567] 10.222.0.36 () {56 vars in 1137 bytes} [Sat Oct 8 20:33:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:53.161872 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbed25-a207-43b3-90f1-fbb647c36af5 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:53.185229 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b6196-a6c0-4ed5-9b72-e00cb387bae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:53.185229 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b6196-a6c0-4ed5-9b72-e00cb387bae6 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:53.185229 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b6196-a6c0-4ed5-9b72-e00cb387bae6 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:53.185229 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b6196-a6c0-4ed5-9b72-e00cb387bae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:53.200958 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b6196-a6c0-4ed5-9b72-e00cb387bae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:53.202437 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b6196-a6c0-4ed5-9b72-e00cb387bae6 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-a05b6196-a6c0-4ed5-9b72-e00cb387bae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:53.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:53.218598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:53.219887 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:53.219887 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:53.219887 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:53.219887 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 283/568] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:53.219887 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b6196-a6c0-4ed5-9b72-e00cb387bae6 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:53.223548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:53.279326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbed25-a207-43b3-90f1-fbb647c36af5 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:53.298375 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:53.317465 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2cdc3-8a56-43d3-98e1-f90cd32d99e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:53.318251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2cdc3-8a56-43d3-98e1-f90cd32d99e8 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:53.318538 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2cdc3-8a56-43d3-98e1-f90cd32d99e8 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:53.319111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2cdc3-8a56-43d3-98e1-f90cd32d99e8 None admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:53.319852 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2cdc3-8a56-43d3-98e1-f90cd32d99e8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:53.320161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2cdc3-8a56-43d3-98e1-f90cd32d99e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:53.321577 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2cdc3-8a56-43d3-98e1-f90cd32d99e8 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:53.328228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b6196-a6c0-4ed5-9b72-e00cb387bae6 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:53.344300 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 286/569] 10.222.0.36 () {56 vars in 1139 bytes} [Sat Oct 8 20:33:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:53.344300 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2cdc3-8a56-43d3-98e1-f90cd32d99e8 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:53.368703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6d040-fec1-4be1-9fa2-1e8af143dd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:53.369353 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6d040-fec1-4be1-9fa2-1e8af143dd00 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:53.369613 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6d040-fec1-4be1-9fa2-1e8af143dd00 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:53.369922 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6d040-fec1-4be1-9fa2-1e8af143dd00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:53.381524 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6d040-fec1-4be1-9fa2-1e8af143dd00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:53.383005 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6d040-fec1-4be1-9fa2-1e8af143dd00 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-c9b6d040-fec1-4be1-9fa2-1e8af143dd00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:53.399858 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:53.400757 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:53.400757 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:53.400757 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:53.400757 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 284/570] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:53.400757 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6d040-fec1-4be1-9fa2-1e8af143dd00 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:53.451014 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2cdc3-8a56-43d3-98e1-f90cd32d99e8 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:53.457720 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:53.493771 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b33d1-15bd-4878-854c-217388296db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:53.494513 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b33d1-15bd-4878-854c-217388296db0 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:53.494791 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b33d1-15bd-4878-854c-217388296db0 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:53.495065 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b33d1-15bd-4878-854c-217388296db0 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:53.495706 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b33d1-15bd-4878-854c-217388296db0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:53.496011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b33d1-15bd-4878-854c-217388296db0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:53.497455 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b33d1-15bd-4878-854c-217388296db0 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:53.509479 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 287/571] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:53.509715 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6d040-fec1-4be1-9fa2-1e8af143dd00 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:53.510311 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b33d1-15bd-4878-854c-217388296db0 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:53.549087 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:53.553564 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79256d-f8ac-45a0-a5b0-986bdabb74c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:53.554226 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79256d-f8ac-45a0-a5b0-986bdabb74c3 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:53.554505 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79256d-f8ac-45a0-a5b0-986bdabb74c3 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:53.554775 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79256d-f8ac-45a0-a5b0-986bdabb74c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:53.566609 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79256d-f8ac-45a0-a5b0-986bdabb74c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:53.568147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79256d-f8ac-45a0-a5b0-986bdabb74c3 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-9a79256d-f8ac-45a0-a5b0-986bdabb74c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:53.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:53.584669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:53.585579 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:53.585579 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:53.585579 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:53.585579 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 285/572] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:53.585579 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79256d-f8ac-45a0-a5b0-986bdabb74c3 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:53.621743 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b33d1-15bd-4878-854c-217388296db0 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:53.656865 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a58115-8347-4c62-8c8f-e033f5d7a7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:53.657474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a58115-8347-4c62-8c8f-e033f5d7a7ba None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:53.657754 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a58115-8347-4c62-8c8f-e033f5d7a7ba None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:53.658175 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a58115-8347-4c62-8c8f-e033f5d7a7ba None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:53.658853 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a58115-8347-4c62-8c8f-e033f5d7a7ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:53.659158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a58115-8347-4c62-8c8f-e033f5d7a7ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:53.660552 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a58115-8347-4c62-8c8f-e033f5d7a7ba None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:53.673924 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 288/573] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:53.673924 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a58115-8347-4c62-8c8f-e033f5d7a7ba None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:53.697611 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79256d-f8ac-45a0-a5b0-986bdabb74c3 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:53.705141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:53.738547 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae839acd-a981-463d-aac9-4c59c6056cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:53.739174 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae839acd-a981-463d-aac9-4c59c6056cab None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:53.739451 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae839acd-a981-463d-aac9-4c59c6056cab None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:53.739719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae839acd-a981-463d-aac9-4c59c6056cab None admin] PATH_INFO: `/v3/projects/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:53.746425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae839acd-a981-463d-aac9-4c59c6056cab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:53.747846 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae839acd-a981-463d-aac9-4c59c6056cab None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:53.759630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-ae839acd-a981-463d-aac9-4c59c6056cab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:53.759630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:53.759630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:53.759630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:53.759630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:53.759630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:53.759630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:53.759630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:53.759630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:53.759630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:53.759630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:53.759630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:53.759630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:33:53.759630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:33:53.759630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:53.760558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:53.761498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:33:53.761498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:33:53.761498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:33:53.761498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:33:53.761498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:33:53.761498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:33:53.761498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:53.761498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:53.761498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 286/574] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:53.761498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae839acd-a981-463d-aac9-4c59c6056cab None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:53.777940 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:53.786423 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a58115-8347-4c62-8c8f-e033f5d7a7ba None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:53.822304 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026ba10-2258-4f10-9195-bc3ef4c46a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:53.822838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ba10-2258-4f10-9195-bc3ef4c46a3e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:53.823114 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ba10-2258-4f10-9195-bc3ef4c46a3e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:53.823428 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ba10-2258-4f10-9195-bc3ef4c46a3e None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:53.824187 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026ba10-2258-4f10-9195-bc3ef4c46a3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:53.824492 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026ba10-2258-4f10-9195-bc3ef4c46a3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:53.825840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026ba10-2258-4f10-9195-bc3ef4c46a3e None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:53.841413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 289/575] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:53.842112 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026ba10-2258-4f10-9195-bc3ef4c46a3e None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:53.868479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae839acd-a981-463d-aac9-4c59c6056cab None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:53.903002 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001c0a7-b6a3-4bdf-895f-a66725c0f739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:53.903625 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001c0a7-b6a3-4bdf-895f-a66725c0f739 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:53.903905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001c0a7-b6a3-4bdf-895f-a66725c0f739 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:53.904185 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001c0a7-b6a3-4bdf-895f-a66725c0f739 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:53.910792 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001c0a7-b6a3-4bdf-895f-a66725c0f739 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:53.912193 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001c0a7-b6a3-4bdf-895f-a66725c0f739 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:53.923217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-9001c0a7-b6a3-4bdf-895f-a66725c0f739 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:53.923217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:53.923217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:53.923217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:53.923217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:53.923217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:53.923217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:53.923217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:53.923217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:53.923217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:53.923217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:53.923217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:53.923217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:33:53.923217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:33:53.923217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:53.924124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:53.925516 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:33:53.925516 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:33:53.925516 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:33:53.925516 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:33:53.925516 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:33:53.925516 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:33:53.925516 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:53.925516 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:53.925516 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 287/576] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:53.926612 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001c0a7-b6a3-4bdf-895f-a66725c0f739 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:53.948517 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026ba10-2258-4f10-9195-bc3ef4c46a3e None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:53.953158 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:53.985209 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784ab09-b5fe-4c08-8d81-96b9812d16db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:53.985817 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784ab09-b5fe-4c08-8d81-96b9812d16db None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:53.986142 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784ab09-b5fe-4c08-8d81-96b9812d16db None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:53.986421 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784ab09-b5fe-4c08-8d81-96b9812d16db None admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:53.987393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784ab09-b5fe-4c08-8d81-96b9812d16db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:53.987702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784ab09-b5fe-4c08-8d81-96b9812d16db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:53.989133 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784ab09-b5fe-4c08-8d81-96b9812d16db None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:54.005691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 290/577] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:33:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:54.006515 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784ab09-b5fe-4c08-8d81-96b9812d16db None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:54.022106 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:54.035619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001c0a7-b6a3-4bdf-895f-a66725c0f739 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:54.073948 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509daa3f-c84d-46da-887d-16e887b89e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:54.074635 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509daa3f-c84d-46da-887d-16e887b89e3d None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:54.074983 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509daa3f-c84d-46da-887d-16e887b89e3d None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:54.075330 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509daa3f-c84d-46da-887d-16e887b89e3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:54.082733 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509daa3f-c84d-46da-887d-16e887b89e3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:54.084210 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509daa3f-c84d-46da-887d-16e887b89e3d None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:54.095333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-509daa3f-c84d-46da-887d-16e887b89e3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:54.095333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:54.095333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:54.095333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:54.095333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:54.095333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:54.095333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:54.095333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:54.095333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:54.095333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:54.095333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:54.095333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:54.095333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:33:54.095333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:33:54.095333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:54.096523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:54.097474 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:33:54.097474 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:33:54.097474 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:33:54.097474 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:33:54.097474 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:33:54.097474 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:33:54.097474 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:54.097474 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:54.097474 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 288/578] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:54.098095 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509daa3f-c84d-46da-887d-16e887b89e3d None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:54.125217 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784ab09-b5fe-4c08-8d81-96b9812d16db None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:54.168096 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b8bb5-3d5b-4250-adfc-f0a52f00769d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:54.168716 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b8bb5-3d5b-4250-adfc-f0a52f00769d None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:54.169052 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b8bb5-3d5b-4250-adfc-f0a52f00769d None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:54.169360 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b8bb5-3d5b-4250-adfc-f0a52f00769d None admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:54.170043 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b8bb5-3d5b-4250-adfc-f0a52f00769d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:54.170711 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b8bb5-3d5b-4250-adfc-f0a52f00769d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:54.171778 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b8bb5-3d5b-4250-adfc-f0a52f00769d None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:54.184160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 291/579] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:33:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:54.184160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b8bb5-3d5b-4250-adfc-f0a52f00769d None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:54.195549 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:54.212584 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509daa3f-c84d-46da-887d-16e887b89e3d None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:54.246123 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06bbdd-3b1a-4670-a11f-7b3f8369a13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:54.246798 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06bbdd-3b1a-4670-a11f-7b3f8369a13a None admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:54.247114 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06bbdd-3b1a-4670-a11f-7b3f8369a13a None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:54.247393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06bbdd-3b1a-4670-a11f-7b3f8369a13a None admin] PATH_INFO: `/v3/projects/bac7915cef1d4e3288a30fd015fcce50/users/7210700b41444499b0a6cfe978445247/roles/b849f9edba724fe5a0d7d1e8da249400` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:54.262688 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06bbdd-3b1a-4670-a11f-7b3f8369a13a None admin] RBAC: Authorizing `identity:create_grant(project_id=bac7915cef1d4e3288a30fd015fcce50, user_id=7210700b41444499b0a6cfe978445247, role_id=b849f9edba724fe5a0d7d1e8da249400)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:54.264254 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06bbdd-3b1a-4670-a11f-7b3f8369a13a None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:54.269440 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:54.277263 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 289/580] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:33:54 2022] PUT /identity/v3/projects/bac7915cef1d4e3288a30fd015fcce50/users/7210700b41444499b0a6cfe978445247/roles/b849f9edba724fe5a0d7d1e8da249400 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:33:54.278308 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06bbdd-3b1a-4670-a11f-7b3f8369a13a None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:54.314058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b8bb5-3d5b-4250-adfc-f0a52f00769d None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:54.355930 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d768062-d4c4-4948-9c0d-671ec00134c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:54.357955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d768062-d4c4-4948-9c0d-671ec00134c2 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:54.358717 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d768062-d4c4-4948-9c0d-671ec00134c2 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:54.359167 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d768062-d4c4-4948-9c0d-671ec00134c2 None admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:54.360056 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d768062-d4c4-4948-9c0d-671ec00134c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:54.360611 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d768062-d4c4-4948-9c0d-671ec00134c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:54.362856 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d768062-d4c4-4948-9c0d-671ec00134c2 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:54.377320 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 292/581] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:33:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:54.386987 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d768062-d4c4-4948-9c0d-671ec00134c2 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:54.435741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06bbdd-3b1a-4670-a11f-7b3f8369a13a None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:54.474750 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213e6df-9f2e-436c-a879-81de567fefc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:54.475448 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213e6df-9f2e-436c-a879-81de567fefc8 None admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:54.475737 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213e6df-9f2e-436c-a879-81de567fefc8 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:54.476074 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213e6df-9f2e-436c-a879-81de567fefc8 None admin] PATH_INFO: `/v3/projects/bac7915cef1d4e3288a30fd015fcce50/users/e2efb666066f4caaa7353656984b5bcd/roles/b849f9edba724fe5a0d7d1e8da249400` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:54.480599 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:54.506403 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213e6df-9f2e-436c-a879-81de567fefc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=bac7915cef1d4e3288a30fd015fcce50, user_id=e2efb666066f4caaa7353656984b5bcd, role_id=b849f9edba724fe5a0d7d1e8da249400)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:54.508001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213e6df-9f2e-436c-a879-81de567fefc8 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:54.522522 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d768062-d4c4-4948-9c0d-671ec00134c2 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:54.529415 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 290/582] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:33:54 2022] PUT /identity/v3/projects/bac7915cef1d4e3288a30fd015fcce50/users/e2efb666066f4caaa7353656984b5bcd/roles/b849f9edba724fe5a0d7d1e8da249400 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:33:54.567977 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868aaad-866c-49ae-ad65-2276f2b629b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:54.568842 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868aaad-866c-49ae-ad65-2276f2b629b6 None admin] REQUEST_METHOD: `PUT` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:54.569264 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868aaad-866c-49ae-ad65-2276f2b629b6 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:54.569629 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868aaad-866c-49ae-ad65-2276f2b629b6 None admin] PATH_INFO: `/v3/projects/bac7915cef1d4e3288a30fd015fcce50/users/98b1f2e36ec948eabeb7c0c1bdf87216/roles/b849f9edba724fe5a0d7d1e8da249400` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:54.573822 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:54.589756 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868aaad-866c-49ae-ad65-2276f2b629b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bac7915cef1d4e3288a30fd015fcce50, user_id=98b1f2e36ec948eabeb7c0c1bdf87216, role_id=b849f9edba724fe5a0d7d1e8da249400)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:54.591464 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868aaad-866c-49ae-ad65-2276f2b629b6 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:54.608709 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 293/583] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:33:54 2022] PUT /identity/v3/projects/bac7915cef1d4e3288a30fd015fcce50/users/98b1f2e36ec948eabeb7c0c1bdf87216/roles/b849f9edba724fe5a0d7d1e8da249400 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:33:55.433606 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd058b43-a897-4c21-8e38-dccffe096b02 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:55.434128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd058b43-a897-4c21-8e38-dccffe096b02 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:55.434128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd058b43-a897-4c21-8e38-dccffe096b02 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:55.435661 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 291/584] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:55.441734 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c58b98-dba6-45ca-84f6-60a6a744acfc None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:55.442241 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c58b98-dba6-45ca-84f6-60a6a744acfc None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:55.442493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c58b98-dba6-45ca-84f6-60a6a744acfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:55.460979 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-63c58b98-dba6-45ca-84f6-60a6a744acfc None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:55.462197 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-63c58b98-dba6-45ca-84f6-60a6a744acfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:55.532447 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 294/585] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:33:55.858800 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd058b43-a897-4c21-8e38-dccffe096b02 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:55.968463 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd058b43-a897-4c21-8e38-dccffe096b02 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:56.005048 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cb192-b656-4216-b803-f024f56ecd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:56.005679 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cb192-b656-4216-b803-f024f56ecd73 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:56.005997 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cb192-b656-4216-b803-f024f56ecd73 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:56.006320 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cb192-b656-4216-b803-f024f56ecd73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:56.016702 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cb192-b656-4216-b803-f024f56ecd73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-1d7cb192-b656-4216-b803-f024f56ecd73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:56.021525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:56.022486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:56.023325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:56.023325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:56.023325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:56.023325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:56.023325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:56.023325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:56.023325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:56.023325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:56.023325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:56.023325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:56.023325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:56.023325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:56.023325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 292/586] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:33:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:56.028879 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c58b98-dba6-45ca-84f6-60a6a744acfc None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:56.140906 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c58b98-dba6-45ca-84f6-60a6a744acfc None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:56.156029 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:56.177433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad275ab-9ae6-4b4c-af1c-8a879dce9002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:56.178077 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad275ab-9ae6-4b4c-af1c-8a879dce9002 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:56.178355 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad275ab-9ae6-4b4c-af1c-8a879dce9002 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:56.178624 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad275ab-9ae6-4b4c-af1c-8a879dce9002 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:56.179276 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad275ab-9ae6-4b4c-af1c-8a879dce9002 None admin] RBAC: Adding query filter params (name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:56.179590 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad275ab-9ae6-4b4c-af1c-8a879dce9002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:56.180923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad275ab-9ae6-4b4c-af1c-8a879dce9002 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:56.189386 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 295/587] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Oct 8 20:33:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:56.194660 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cb192-b656-4216-b803-f024f56ecd73 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:56.242467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:56.296431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cb192-b656-4216-b803-f024f56ecd73 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:56.337367 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03186f5f-de41-41a6-ac70-6f3316dda558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:56.338023 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03186f5f-de41-41a6-ac70-6f3316dda558 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:56.338307 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03186f5f-de41-41a6-ac70-6f3316dda558 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:56.338582 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03186f5f-de41-41a6-ac70-6f3316dda558 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:56.348919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03186f5f-de41-41a6-ac70-6f3316dda558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:56.350541 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03186f5f-de41-41a6-ac70-6f3316dda558 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-03186f5f-de41-41a6-ac70-6f3316dda558 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:56.366540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:56.367511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:56.368418 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:56.368418 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:56.368418 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:56.368418 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 293/588] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:33:56.373856 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad275ab-9ae6-4b4c-af1c-8a879dce9002 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:56.488955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad275ab-9ae6-4b4c-af1c-8a879dce9002 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:56.524542 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7b13c-61b5-4abd-bce2-595c23671ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:56.525152 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7b13c-61b5-4abd-bce2-595c23671ff0 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:56.525432 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7b13c-61b5-4abd-bce2-595c23671ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:56.525706 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7b13c-61b5-4abd-bce2-595c23671ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:56.526532 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7b13c-61b5-4abd-bce2-595c23671ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:56.526838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7b13c-61b5-4abd-bce2-595c23671ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:56.528197 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7b13c-61b5-4abd-bce2-595c23671ff0 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:56.546140 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 296/589] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:56.547729 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03186f5f-de41-41a6-ac70-6f3316dda558 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:56.654703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:56.658885 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03186f5f-de41-41a6-ac70-6f3316dda558 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:56.696594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7af057-ae3f-466f-a3df-d0b3d9676921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:56.697228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7af057-ae3f-466f-a3df-d0b3d9676921 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:56.697680 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7af057-ae3f-466f-a3df-d0b3d9676921 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:56.697988 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7af057-ae3f-466f-a3df-d0b3d9676921 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:56.706632 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7af057-ae3f-466f-a3df-d0b3d9676921 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:56.708293 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7af057-ae3f-466f-a3df-d0b3d9676921 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-2d7af057-ae3f-466f-a3df-d0b3d9676921 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:33:56.721130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:56.722848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:56.723891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:56.723891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:56.723891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:33:56.723891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:33:56.723891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:33:56.723891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:33:56.723891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:33:56.723891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:33:56.723891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:33:56.723891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:56.723891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 294/590] 10.222.0.36 () {56 vars in 1093 bytes} [Sat Oct 8 20:33:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:56.729226 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7b13c-61b5-4abd-bce2-595c23671ff0 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:56.767715 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:56.835424 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7b13c-61b5-4abd-bce2-595c23671ff0 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:56.870984 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c9618-86d2-491e-beb7-9ed71c587cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:56.871597 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c9618-86d2-491e-beb7-9ed71c587cec None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:56.871879 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c9618-86d2-491e-beb7-9ed71c587cec None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:56.872153 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c9618-86d2-491e-beb7-9ed71c587cec None admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:56.872871 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c9618-86d2-491e-beb7-9ed71c587cec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:56.873177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c9618-86d2-491e-beb7-9ed71c587cec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:56.874660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c9618-86d2-491e-beb7-9ed71c587cec None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:56.892423 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 297/591] 10.222.0.36 () {56 vars in 1133 bytes} [Sat Oct 8 20:33:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:56.895487 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b808fe-1b92-4a23-98e0-fb3739041717 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:56.895984 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b808fe-1b92-4a23-98e0-fb3739041717 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:56.896470 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b808fe-1b92-4a23-98e0-fb3739041717 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:56.898446 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c9618-86d2-491e-beb7-9ed71c587cec None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:56.898674 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 295/592] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:56.903990 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff0d83-8da8-4563-b6f4-6b15cf9a8e31 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:56.904514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff0d83-8da8-4563-b6f4-6b15cf9a8e31 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:56.904999 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff0d83-8da8-4563-b6f4-6b15cf9a8e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:56.924674 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-bfff0d83-8da8-4563-b6f4-6b15cf9a8e31 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:56.926382 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-bfff0d83-8da8-4563-b6f4-6b15cf9a8e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:56.996564 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:57.011490 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c9618-86d2-491e-beb7-9ed71c587cec None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:57.028948 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 296/593] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:33:57.054365 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c29e7-25d6-49e1-b524-ee9d5d4fa70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:57.054988 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c29e7-25d6-49e1-b524-ee9d5d4fa70d None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:57.055267 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c29e7-25d6-49e1-b524-ee9d5d4fa70d None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:57.055542 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c29e7-25d6-49e1-b524-ee9d5d4fa70d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:57.102977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60e184-7d05-470a-ae5a-ec0a67fdbebb None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:57.103275 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60e184-7d05-470a-ae5a-ec0a67fdbebb None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:57.103553 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60e184-7d05-470a-ae5a-ec0a67fdbebb None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:57.104884 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 297/594] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:33:57.110420 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442666f-45bf-4cc0-b7c5-49e1113ef1ce None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:57.110936 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442666f-45bf-4cc0-b7c5-49e1113ef1ce None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:57.111427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442666f-45bf-4cc0-b7c5-49e1113ef1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:57.127535 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c29e7-25d6-49e1-b524-ee9d5d4fa70d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:57.128972 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c29e7-25d6-49e1-b524-ee9d5d4fa70d None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:57.133361 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-e442666f-45bf-4cc0-b7c5-49e1113ef1ce None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:57.134820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-e442666f-45bf-4cc0-b7c5-49e1113ef1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:57.217938 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 298/595] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:33:57.218547 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308bfaf-a599-4a77-a751-a3457c934f46 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:57.218829 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308bfaf-a599-4a77-a751-a3457c934f46 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:57.219103 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308bfaf-a599-4a77-a751-a3457c934f46 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:57.220486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 299/596] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:33:57.226187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d0d40-2731-4f28-873e-5c9be8b0d698 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:57.226477 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d0d40-2731-4f28-873e-5c9be8b0d698 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:57.226773 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d0d40-2731-4f28-873e-5c9be8b0d698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:57.236121 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:57.244602 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 298/597] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:57.247348 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-ef9d0d40-2731-4f28-873e-5c9be8b0d698 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:33:57.248712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-ef9d0d40-2731-4f28-873e-5c9be8b0d698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:33:57.250629 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c29e7-25d6-49e1-b524-ee9d5d4fa70d None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:57.271587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:57.334409 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 300/598] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:33:57.351352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c29e7-25d6-49e1-b524-ee9d5d4fa70d None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:57.373802 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d0d40-2731-4f28-873e-5c9be8b0d698 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:57.393368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a355c6-07b0-4864-a80d-e3540fe9540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:57.394202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a355c6-07b0-4864-a80d-e3540fe9540e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:57.394484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a355c6-07b0-4864-a80d-e3540fe9540e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:57.394761 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a355c6-07b0-4864-a80d-e3540fe9540e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:57.406719 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a355c6-07b0-4864-a80d-e3540fe9540e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:57.408142 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a355c6-07b0-4864-a80d-e3540fe9540e None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-86a355c6-07b0-4864-a80d-e3540fe9540e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:57.426537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:57.427507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:57.428401 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:57.428401 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:57.428401 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:57.428401 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 299/599] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:33:57.433305 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a355c6-07b0-4864-a80d-e3540fe9540e None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:57.496024 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:57.508121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d0d40-2731-4f28-873e-5c9be8b0d698 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:57.553173 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd5cbe-9781-4bc3-a83f-ce569cbcab27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:57.553788 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd5cbe-9781-4bc3-a83f-ce569cbcab27 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:57.554172 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd5cbe-9781-4bc3-a83f-ce569cbcab27 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:57.554355 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd5cbe-9781-4bc3-a83f-ce569cbcab27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:57.564669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd5cbe-9781-4bc3-a83f-ce569cbcab27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:57.566796 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a355c6-07b0-4864-a80d-e3540fe9540e None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-23fd5cbe-9781-4bc3-a83f-ce569cbcab27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:57.570076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:57.571031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:57.571955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:57.571955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:57.571955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:57.571955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:57.571955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:57.571955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:57.571955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:57.571955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:57.571955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:57.571955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:57.571955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:57.571955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:57.571955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 301/600] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:33:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:33:57.571955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd5cbe-9781-4bc3-a83f-ce569cbcab27 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:57.583719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:57.609967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa5ca7-b22d-45e6-9bad-c9437aa23e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:57.610499 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa5ca7-b22d-45e6-9bad-c9437aa23e10 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:57.610775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa5ca7-b22d-45e6-9bad-c9437aa23e10 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:57.611043 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa5ca7-b22d-45e6-9bad-c9437aa23e10 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:57.611680 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa5ca7-b22d-45e6-9bad-c9437aa23e10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:57.611976 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa5ca7-b22d-45e6-9bad-c9437aa23e10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:57.613310 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa5ca7-b22d-45e6-9bad-c9437aa23e10 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:57.629194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 300/601] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:33:57.629194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa5ca7-b22d-45e6-9bad-c9437aa23e10 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:57.681738 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd5cbe-9781-4bc3-a83f-ce569cbcab27 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:57.717150 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a82359-3f3f-4f24-b39f-cd73c867b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:57.717772 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a82359-3f3f-4f24-b39f-cd73c867b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:57.718077 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a82359-3f3f-4f24-b39f-cd73c867b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:57.718348 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a82359-3f3f-4f24-b39f-cd73c867b0a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:57.728185 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa5ca7-b22d-45e6-9bad-c9437aa23e10 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:57.728964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a82359-3f3f-4f24-b39f-cd73c867b0a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-82a82359-3f3f-4f24-b39f-cd73c867b0a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:57.734940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:57.735905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:57.736791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:57.736791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:57.736791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:57.736791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:57.736791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:57.736791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:57.736791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:57.736791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:57.736791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:57.736791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:57.736791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:57.736791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:57.737516 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:57.737589 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 302/602] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:33:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:57.737589 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a82359-3f3f-4f24-b39f-cd73c867b0a2 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:57.762146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20be35-0d2f-4d3f-8d66-f8e62fbb54da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:57.762745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20be35-0d2f-4d3f-8d66-f8e62fbb54da None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:57.763020 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20be35-0d2f-4d3f-8d66-f8e62fbb54da None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:57.763293 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20be35-0d2f-4d3f-8d66-f8e62fbb54da None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:57.763939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20be35-0d2f-4d3f-8d66-f8e62fbb54da None admin] RBAC: Adding query filter params (name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:57.764237 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20be35-0d2f-4d3f-8d66-f8e62fbb54da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:57.765567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20be35-0d2f-4d3f-8d66-f8e62fbb54da None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:57.773602 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 301/603] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Oct 8 20:33:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:57.774413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20be35-0d2f-4d3f-8d66-f8e62fbb54da None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:57.804205 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:57.836495 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a82359-3f3f-4f24-b39f-cd73c867b0a2 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:57.869798 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9951cde-4ad9-4a27-bc61-9fc3fe1141cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:57.870384 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9951cde-4ad9-4a27-bc61-9fc3fe1141cb None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:57.870674 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9951cde-4ad9-4a27-bc61-9fc3fe1141cb None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:57.870950 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9951cde-4ad9-4a27-bc61-9fc3fe1141cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:57.874507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20be35-0d2f-4d3f-8d66-f8e62fbb54da None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:57.878125 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9951cde-4ad9-4a27-bc61-9fc3fe1141cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:57.879563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9951cde-4ad9-4a27-bc61-9fc3fe1141cb None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:57.890607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-f9951cde-4ad9-4a27-bc61-9fc3fe1141cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:57.890607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:57.890607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:57.890607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:57.890607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:57.890607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:57.890607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:57.890607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:57.890607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:57.890607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:57.890607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:57.890607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:57.890607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:33:57.890607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:33:57.890607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:57.891493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:57.892621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:33:57.892621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:33:57.892621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:33:57.892621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:33:57.892621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:33:57.892621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:33:57.892621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:33:57.892621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:57.892621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 303/604] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:33:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:57.892621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9951cde-4ad9-4a27-bc61-9fc3fe1141cb None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:57.910241 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63a9b5-e496-405f-8784-37548d5349f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:57.910872 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63a9b5-e496-405f-8784-37548d5349f9 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:57.911152 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63a9b5-e496-405f-8784-37548d5349f9 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:57.911431 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63a9b5-e496-405f-8784-37548d5349f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:57.921044 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63a9b5-e496-405f-8784-37548d5349f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-9c63a9b5-e496-405f-8784-37548d5349f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:33:57.926775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:57.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:57.930902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:57.930902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:57.930902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:57.930902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:57.930902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:33:57.930902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:33:57.930902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:33:57.930902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:33:57.930902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:33:57.930902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:33:57.930902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:33:57.930902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:57.930902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 302/605] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:33:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:57.930902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63a9b5-e496-405f-8784-37548d5349f9 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:57.955139 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:57.991697 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9951cde-4ad9-4a27-bc61-9fc3fe1141cb None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:58.017658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:58.026068 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3e541-cf33-469e-9a29-6bee15dcd802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:58.026680 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3e541-cf33-469e-9a29-6bee15dcd802 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:58.026962 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3e541-cf33-469e-9a29-6bee15dcd802 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:58.027244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3e541-cf33-469e-9a29-6bee15dcd802 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:58.027900 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3e541-cf33-469e-9a29-6bee15dcd802 None admin] RBAC: Adding query filter params (name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:58.028206 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3e541-cf33-469e-9a29-6bee15dcd802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:58.029560 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3e541-cf33-469e-9a29-6bee15dcd802 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:58.032647 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63a9b5-e496-405f-8784-37548d5349f9 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:58.038067 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 304/606] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Oct 8 20:33:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:58.039115 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3e541-cf33-469e-9a29-6bee15dcd802 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:58.069987 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014a557-0f06-4bdd-868c-a232a6aba7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:58.070618 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014a557-0f06-4bdd-868c-a232a6aba7e2 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:58.070899 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014a557-0f06-4bdd-868c-a232a6aba7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:58.071167 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014a557-0f06-4bdd-868c-a232a6aba7e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:58.081274 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014a557-0f06-4bdd-868c-a232a6aba7e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:58.082752 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014a557-0f06-4bdd-868c-a232a6aba7e2 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-5014a557-0f06-4bdd-868c-a232a6aba7e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:58.096939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:58.097859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:58.099229 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:58.099229 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:58.099229 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:58.099229 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 303/607] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:58.099229 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014a557-0f06-4bdd-868c-a232a6aba7e2 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:58.140873 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3e541-cf33-469e-9a29-6bee15dcd802 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:58.173493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d21f8-4882-458c-b969-3e7d7635f4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:58.174193 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d21f8-4882-458c-b969-3e7d7635f4cb None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:58.174956 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d21f8-4882-458c-b969-3e7d7635f4cb None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:58.175225 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d21f8-4882-458c-b969-3e7d7635f4cb None admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:58.175900 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d21f8-4882-458c-b969-3e7d7635f4cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:58.176203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d21f8-4882-458c-b969-3e7d7635f4cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:58.177612 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d21f8-4882-458c-b969-3e7d7635f4cb None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:58.178066 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:58.189675 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 305/608] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:33:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:58.190765 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d21f8-4882-458c-b969-3e7d7635f4cb None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:58.198603 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014a557-0f06-4bdd-868c-a232a6aba7e2 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:58.232069 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69b1b7-e8c5-4534-9c7a-eb021f520ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:58.232871 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69b1b7-e8c5-4534-9c7a-eb021f520ccb None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:58.233149 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69b1b7-e8c5-4534-9c7a-eb021f520ccb None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:58.233670 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69b1b7-e8c5-4534-9c7a-eb021f520ccb None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:58.234352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69b1b7-e8c5-4534-9c7a-eb021f520ccb None admin] RBAC: Adding query filter params (name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:58.234655 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69b1b7-e8c5-4534-9c7a-eb021f520ccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:58.236017 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69b1b7-e8c5-4534-9c7a-eb021f520ccb None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:58.239169 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:58.248402 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 304/609] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Oct 8 20:33:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:58.248402 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69b1b7-e8c5-4534-9c7a-eb021f520ccb None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:58.289648 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d21f8-4882-458c-b969-3e7d7635f4cb None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:58.325173 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd86d74-2520-4f49-a8fa-0c6c04a125d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:58.325806 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd86d74-2520-4f49-a8fa-0c6c04a125d2 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:58.326118 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd86d74-2520-4f49-a8fa-0c6c04a125d2 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:58.326398 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd86d74-2520-4f49-a8fa-0c6c04a125d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:58.337358 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd86d74-2520-4f49-a8fa-0c6c04a125d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:58.338820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd86d74-2520-4f49-a8fa-0c6c04a125d2 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:58.342043 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69b1b7-e8c5-4534-9c7a-eb021f520ccb None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-7bd86d74-2520-4f49-a8fa-0c6c04a125d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:58.353202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:58.354238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:58.355302 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:58.355302 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:58.355302 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:58.355302 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 306/610] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:58.355302 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd86d74-2520-4f49-a8fa-0c6c04a125d2 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:58.377123 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02153175-b8ae-4a91-89b9-0c258d3d15f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:58.378446 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02153175-b8ae-4a91-89b9-0c258d3d15f4 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:58.378722 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02153175-b8ae-4a91-89b9-0c258d3d15f4 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:58.378994 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02153175-b8ae-4a91-89b9-0c258d3d15f4 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:58.379626 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02153175-b8ae-4a91-89b9-0c258d3d15f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:58.379928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02153175-b8ae-4a91-89b9-0c258d3d15f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:58.381281 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02153175-b8ae-4a91-89b9-0c258d3d15f4 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:58.392601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 305/611] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:58.393397 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02153175-b8ae-4a91-89b9-0c258d3d15f4 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:58.396164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:58.456547 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd86d74-2520-4f49-a8fa-0c6c04a125d2 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:58.458081 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:58.490156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5da27d-e1b1-4ed4-a617-9dab04966027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:58.490753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5da27d-e1b1-4ed4-a617-9dab04966027 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:58.491032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5da27d-e1b1-4ed4-a617-9dab04966027 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:58.491305 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5da27d-e1b1-4ed4-a617-9dab04966027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:58.491417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02153175-b8ae-4a91-89b9-0c258d3d15f4 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:58.492025 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5da27d-e1b1-4ed4-a617-9dab04966027 None admin] RBAC: Adding query filter params (role.id=b849f9edba724fe5a0d7d1e8da249400, scope.project.id=bac7915cef1d4e3288a30fd015fcce50, user.id=017db52cc36f4bdb9448afe74edab753) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:58.492333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5da27d-e1b1-4ed4-a617-9dab04966027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:58.493799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5da27d-e1b1-4ed4-a617-9dab04966027 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:58.499380 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 307/612] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:33:58 2022] GET /identity/v3/role_assignments?user.id=017db52cc36f4bdb9448afe74edab753&scope.project.id=bac7915cef1d4e3288a30fd015fcce50&role.id=b849f9edba724fe5a0d7d1e8da249400 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:58.500153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5da27d-e1b1-4ed4-a617-9dab04966027 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:58.547892 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67029b9-20d5-4f95-a407-7435f07ef00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:58.548627 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67029b9-20d5-4f95-a407-7435f07ef00e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:58.549019 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67029b9-20d5-4f95-a407-7435f07ef00e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:58.549390 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67029b9-20d5-4f95-a407-7435f07ef00e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:58.561726 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67029b9-20d5-4f95-a407-7435f07ef00e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:58.563800 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67029b9-20d5-4f95-a407-7435f07ef00e None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-e67029b9-20d5-4f95-a407-7435f07ef00e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:58.583344 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:58.584413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:58.585305 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:58.585305 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:58.585305 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:58.585305 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 306/613] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:58.585554 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67029b9-20d5-4f95-a407-7435f07ef00e None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:58.614369 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5da27d-e1b1-4ed4-a617-9dab04966027 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:58.655258 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f95bbf-3550-4d41-8c12-2512f0a007db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:58.655920 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:58.656035 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f95bbf-3550-4d41-8c12-2512f0a007db None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:58.656238 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f95bbf-3550-4d41-8c12-2512f0a007db None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:58.656508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f95bbf-3550-4d41-8c12-2512f0a007db None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:58.657599 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f95bbf-3550-4d41-8c12-2512f0a007db None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:58.658268 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f95bbf-3550-4d41-8c12-2512f0a007db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:58.659585 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f95bbf-3550-4d41-8c12-2512f0a007db None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:58.673621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 308/614] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:58.675088 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f95bbf-3550-4d41-8c12-2512f0a007db None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:58.707418 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:58.714296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67029b9-20d5-4f95-a407-7435f07ef00e None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:58.756996 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5bcc7-f62b-4a49-a366-5f5f52387d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:58.758448 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5bcc7-f62b-4a49-a366-5f5f52387d32 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:58.758749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5bcc7-f62b-4a49-a366-5f5f52387d32 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:58.759027 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5bcc7-f62b-4a49-a366-5f5f52387d32 None admin] PATH_INFO: `/v3/users/glance` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:58.768101 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5bcc7-f62b-4a49-a366-5f5f52387d32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:58.769595 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5bcc7-f62b-4a49-a366-5f5f52387d32 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-90c5bcc7-f62b-4a49-a366-5f5f52387d32 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:33:58.786855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:58.787861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:58.788845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:58.788845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:58.788845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:33:58.788845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:33:58.788845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:33:58.788845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:33:58.788845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:33:58.788845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:33:58.788845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 08 20:33:58.788845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:58.788845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 307/615] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:58.788845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5bcc7-f62b-4a49-a366-5f5f52387d32 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:58.797387 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f95bbf-3550-4d41-8c12-2512f0a007db None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:58.836657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f688f-3e7f-438a-aa14-dbd358c87e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:58.837398 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f688f-3e7f-438a-aa14-dbd358c87e0c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:58.837512 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f688f-3e7f-438a-aa14-dbd358c87e0c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:58.837791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f688f-3e7f-438a-aa14-dbd358c87e0c None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:58.838475 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f688f-3e7f-438a-aa14-dbd358c87e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:58.838783 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f688f-3e7f-438a-aa14-dbd358c87e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:58.840118 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f688f-3e7f-438a-aa14-dbd358c87e0c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:58.852286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 309/616] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:58.856946 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f688f-3e7f-438a-aa14-dbd358c87e0c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:58.900569 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5bcc7-f62b-4a49-a366-5f5f52387d32 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:58.916079 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:58.939662 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fe45f-4229-4321-8e61-96041b0dfb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:58.941005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fe45f-4229-4321-8e61-96041b0dfb75 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:58.941332 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fe45f-4229-4321-8e61-96041b0dfb75 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:58.941608 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fe45f-4229-4321-8e61-96041b0dfb75 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:58.946253 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:58.951268 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fe45f-4229-4321-8e61-96041b0dfb75 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:58.952745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fe45f-4229-4321-8e61-96041b0dfb75 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:58.962047 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f688f-3e7f-438a-aa14-dbd358c87e0c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-d38fe45f-4229-4321-8e61-96041b0dfb75 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:33:58.964368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:58.965315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:58.966337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:58.966337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:58.966337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:33:58.966337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:33:58.966337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:33:58.966337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:33:58.966337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:33:58.966337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:33:58.966337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:33:58.966337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:58.966337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 308/617] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:33:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:58.966337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fe45f-4229-4321-8e61-96041b0dfb75 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:59.004629 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e94ce-d344-47d4-9ccc-6a6a471e633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:59.005230 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e94ce-d344-47d4-9ccc-6a6a471e633e None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:59.005509 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e94ce-d344-47d4-9ccc-6a6a471e633e None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:59.005777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e94ce-d344-47d4-9ccc-6a6a471e633e None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:59.006533 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e94ce-d344-47d4-9ccc-6a6a471e633e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:59.006834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e94ce-d344-47d4-9ccc-6a6a471e633e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:59.008242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e94ce-d344-47d4-9ccc-6a6a471e633e None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:59.031496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 310/618] 10.222.0.36 () {56 vars in 1137 bytes} [Sat Oct 8 20:33:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:59.031496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e94ce-d344-47d4-9ccc-6a6a471e633e None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:59.094545 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fe45f-4229-4321-8e61-96041b0dfb75 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:59.129692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55498e9-6719-4f58-9ba9-90ea049a1da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:59.130781 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55498e9-6719-4f58-9ba9-90ea049a1da5 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:59.131071 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55498e9-6719-4f58-9ba9-90ea049a1da5 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:59.131348 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55498e9-6719-4f58-9ba9-90ea049a1da5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:59.142023 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55498e9-6719-4f58-9ba9-90ea049a1da5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:59.142023 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55498e9-6719-4f58-9ba9-90ea049a1da5 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:59.149033 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e94ce-d344-47d4-9ccc-6a6a471e633e None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-f55498e9-6719-4f58-9ba9-90ea049a1da5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:33:59.164740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:59.166188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:59.167543 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:59.167543 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:59.167543 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:33:59.167543 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:33:59.167543 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:33:59.167543 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:33:59.167543 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:33:59.167543 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:33:59.167543 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 08 20:33:59.167543 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:33:59.172380 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 309/619] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:33:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:59.173167 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55498e9-6719-4f58-9ba9-90ea049a1da5 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:59.200359 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdd86d-aee5-4874-a93d-07521f523161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:59.201131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd86d-aee5-4874-a93d-07521f523161 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:59.201577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd86d-aee5-4874-a93d-07521f523161 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:59.201990 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd86d-aee5-4874-a93d-07521f523161 None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:59.202821 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdd86d-aee5-4874-a93d-07521f523161 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:59.203325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdd86d-aee5-4874-a93d-07521f523161 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:59.204962 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdd86d-aee5-4874-a93d-07521f523161 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:59.217120 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:59.230123 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 311/620] 10.222.0.36 () {56 vars in 1137 bytes} [Sat Oct 8 20:33:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:59.230123 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdd86d-aee5-4874-a93d-07521f523161 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:59.231199 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:59.314610 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55498e9-6719-4f58-9ba9-90ea049a1da5 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:59.345186 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdd86d-aee5-4874-a93d-07521f523161 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:59.349836 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221a833-37fd-4a31-96a9-12a3e80891bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:59.350591 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221a833-37fd-4a31-96a9-12a3e80891bb None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:59.350966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221a833-37fd-4a31-96a9-12a3e80891bb None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:59.351332 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221a833-37fd-4a31-96a9-12a3e80891bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:59.380698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642502bf-29b9-4723-86a7-dba08de737fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:59.381389 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642502bf-29b9-4723-86a7-dba08de737fe None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:59.381734 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642502bf-29b9-4723-86a7-dba08de737fe None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:59.382098 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642502bf-29b9-4723-86a7-dba08de737fe None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:59.382867 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642502bf-29b9-4723-86a7-dba08de737fe None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:33:59.383230 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642502bf-29b9-4723-86a7-dba08de737fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:59.384708 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642502bf-29b9-4723-86a7-dba08de737fe None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:59.402100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 312/621] 10.222.0.36 () {56 vars in 1139 bytes} [Sat Oct 8 20:33:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:33:59.402910 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642502bf-29b9-4723-86a7-dba08de737fe None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:59.431437 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221a833-37fd-4a31-96a9-12a3e80891bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:59.432797 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221a833-37fd-4a31-96a9-12a3e80891bb None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:59.464400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:59.464941 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:59.508521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642502bf-29b9-4723-86a7-dba08de737fe None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:59.532849 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 310/622] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:59.538011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221a833-37fd-4a31-96a9-12a3e80891bb None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:59.545036 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d63f20-2119-4313-9e2e-8b33e0f42b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:59.545636 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d63f20-2119-4313-9e2e-8b33e0f42b32 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:59.546054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d63f20-2119-4313-9e2e-8b33e0f42b32 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:59.546333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d63f20-2119-4313-9e2e-8b33e0f42b32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:59.612422 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d63f20-2119-4313-9e2e-8b33e0f42b32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:59.613865 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d63f20-2119-4313-9e2e-8b33e0f42b32 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:59.639427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221a833-37fd-4a31-96a9-12a3e80891bb None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:59.675791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:59.677828 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcab87-3ae5-4204-8643-635c86fe43b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:59.678475 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcab87-3ae5-4204-8643-635c86fe43b7 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:59.678757 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcab87-3ae5-4204-8643-635c86fe43b7 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:59.679027 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcab87-3ae5-4204-8643-635c86fe43b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:59.681790 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:59.725361 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 313/623] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:59.725361 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d63f20-2119-4313-9e2e-8b33e0f42b32 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:59.759876 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcab87-3ae5-4204-8643-635c86fe43b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:59.761320 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcab87-3ae5-4204-8643-635c86fe43b7 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:59.833908 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d63f20-2119-4313-9e2e-8b33e0f42b32 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:33:59.872729 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d6714-38fb-4b3a-b9e8-d56698185acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:33:59.873450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d6714-38fb-4b3a-b9e8-d56698185acc None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:33:59.873735 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d6714-38fb-4b3a-b9e8-d56698185acc None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:33:59.874064 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d6714-38fb-4b3a-b9e8-d56698185acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:33:59.886079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d6714-38fb-4b3a-b9e8-d56698185acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:33:59.887546 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d6714-38fb-4b3a-b9e8-d56698185acc None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-1d4d6714-38fb-4b3a-b9e8-d56698185acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:33:59.904677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:33:59.905743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:33:59.906712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:33:59.906712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:33:59.906712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:33:59.911558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 314/624] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:33:59.912392 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d6714-38fb-4b3a-b9e8-d56698185acc None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:33:59.928966 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:33:59.996492 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 311/625] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:33:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:33:59.996492 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcab87-3ae5-4204-8643-635c86fe43b7 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:00.023502 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d6714-38fb-4b3a-b9e8-d56698185acc None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:00.032660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:00.065709 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594991ec-7975-425e-a736-9ccb3d85775c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:00.066357 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594991ec-7975-425e-a736-9ccb3d85775c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.066636 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594991ec-7975-425e-a736-9ccb3d85775c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.066905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594991ec-7975-425e-a736-9ccb3d85775c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.077288 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594991ec-7975-425e-a736-9ccb3d85775c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:00.078723 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594991ec-7975-425e-a736-9ccb3d85775c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-594991ec-7975-425e-a736-9ccb3d85775c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:34:00.093471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:00.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:34:00.095409 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:34:00.095409 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:00.095409 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:00.095409 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 315/626] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:00.095878 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594991ec-7975-425e-a736-9ccb3d85775c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:00.114250 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcab87-3ae5-4204-8643-635c86fe43b7 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:00.149601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146ec6a-d575-4d80-a5f8-3fc059290498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:00.150233 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146ec6a-d575-4d80-a5f8-3fc059290498 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.150507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146ec6a-d575-4d80-a5f8-3fc059290498 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.150774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146ec6a-d575-4d80-a5f8-3fc059290498 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.151570 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146ec6a-d575-4d80-a5f8-3fc059290498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:00.151986 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146ec6a-d575-4d80-a5f8-3fc059290498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:00.153354 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146ec6a-d575-4d80-a5f8-3fc059290498 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:00.167019 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:00.174797 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 312/627] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:00.174797 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146ec6a-d575-4d80-a5f8-3fc059290498 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:00.214682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594991ec-7975-425e-a736-9ccb3d85775c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:00.256300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1d90a-b8d8-4e3e-b24d-a340e40b3489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:00.256994 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1d90a-b8d8-4e3e-b24d-a340e40b3489 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.257280 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1d90a-b8d8-4e3e-b24d-a340e40b3489 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.257553 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1d90a-b8d8-4e3e-b24d-a340e40b3489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.269236 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:00.271033 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1d90a-b8d8-4e3e-b24d-a340e40b3489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:00.272689 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1d90a-b8d8-4e3e-b24d-a340e40b3489 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:00.276434 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146ec6a-d575-4d80-a5f8-3fc059290498 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-a1f1d90a-b8d8-4e3e-b24d-a340e40b3489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:34:00.291147 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:00.292128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:34:00.293052 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:34:00.293052 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:00.293052 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:00.293052 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 316/628] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:00.293791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1d90a-b8d8-4e3e-b24d-a340e40b3489 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:00.315930 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e8393-1f7f-4dfe-99bb-bd6a80c88d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:00.316624 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e8393-1f7f-4dfe-99bb-bd6a80c88d8b None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.317003 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e8393-1f7f-4dfe-99bb-bd6a80c88d8b None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.317474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e8393-1f7f-4dfe-99bb-bd6a80c88d8b None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.318536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e8393-1f7f-4dfe-99bb-bd6a80c88d8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:00.318855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e8393-1f7f-4dfe-99bb-bd6a80c88d8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:00.320742 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e8393-1f7f-4dfe-99bb-bd6a80c88d8b None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:00.336803 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 313/629] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:00.336803 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e8393-1f7f-4dfe-99bb-bd6a80c88d8b None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:00.407338 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1d90a-b8d8-4e3e-b24d-a340e40b3489 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:00.425172 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:00.443184 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e8393-1f7f-4dfe-99bb-bd6a80c88d8b None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:00.445024 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4526c5-68bf-44c0-9184-d12c440e024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:00.445730 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4526c5-68bf-44c0-9184-d12c440e024c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.446126 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4526c5-68bf-44c0-9184-d12c440e024c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.446411 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4526c5-68bf-44c0-9184-d12c440e024c None admin] PATH_INFO: `/v3/projects/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.453173 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4526c5-68bf-44c0-9184-d12c440e024c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:00.454617 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4526c5-68bf-44c0-9184-d12c440e024c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:00.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-9d4526c5-68bf-44c0-9184-d12c440e024c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:34:00.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:00.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:00.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:00.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:00.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:00.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:00.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:00.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:00.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:00.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:00.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:00.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:34:00.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:34:00.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:00.468149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:00.469437 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:34:00.469437 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:34:00.469437 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:34:00.469437 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:34:00.469437 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:34:00.469437 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:34:00.469437 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:34:00.469437 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:00.469437 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 317/630] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:00.469437 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4526c5-68bf-44c0-9184-d12c440e024c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:00.485014 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c9385-44f6-4426-9e21-65f0ceb61cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:00.485627 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c9385-44f6-4426-9e21-65f0ceb61cc4 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.486077 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c9385-44f6-4426-9e21-65f0ceb61cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.486362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c9385-44f6-4426-9e21-65f0ceb61cc4 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.487031 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c9385-44f6-4426-9e21-65f0ceb61cc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:00.487332 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c9385-44f6-4426-9e21-65f0ceb61cc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:00.488669 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c9385-44f6-4426-9e21-65f0ceb61cc4 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:00.499866 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 314/631] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:00.500710 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c9385-44f6-4426-9e21-65f0ceb61cc4 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:00.521051 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:00.579480 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4526c5-68bf-44c0-9184-d12c440e024c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:00.613055 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c9385-44f6-4426-9e21-65f0ceb61cc4 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:00.621023 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77faec1-4235-42d6-9c12-7c5af649df67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:00.621514 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77faec1-4235-42d6-9c12-7c5af649df67 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.621795 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77faec1-4235-42d6-9c12-7c5af649df67 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.622090 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77faec1-4235-42d6-9c12-7c5af649df67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.630553 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77faec1-4235-42d6-9c12-7c5af649df67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:00.632090 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77faec1-4235-42d6-9c12-7c5af649df67 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:00.644249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-a77faec1-4235-42d6-9c12-7c5af649df67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:34:00.644249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:00.644249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:00.644249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:00.644249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:00.644249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:00.644249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:00.644249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:00.644249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:00.644249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:00.644249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:00.644249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:00.644249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:34:00.644249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:34:00.644249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:00.645162 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:00.650736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:34:00.650736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:34:00.650736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:34:00.650736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:34:00.650736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:34:00.650736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:34:00.650736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:34:00.650736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:00.650736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 318/632] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:00.650736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77faec1-4235-42d6-9c12-7c5af649df67 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:00.651691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159539e4-ac3a-4352-be9a-601ca2ef1f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:00.652209 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159539e4-ac3a-4352-be9a-601ca2ef1f69 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.652493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159539e4-ac3a-4352-be9a-601ca2ef1f69 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.652762 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159539e4-ac3a-4352-be9a-601ca2ef1f69 None admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.653453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159539e4-ac3a-4352-be9a-601ca2ef1f69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:00.653758 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159539e4-ac3a-4352-be9a-601ca2ef1f69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:00.655245 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159539e4-ac3a-4352-be9a-601ca2ef1f69 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:00.668452 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 315/633] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:00.669320 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159539e4-ac3a-4352-be9a-601ca2ef1f69 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:00.695077 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:00.752415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:00.762251 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77faec1-4235-42d6-9c12-7c5af649df67 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:00.780639 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159539e4-ac3a-4352-be9a-601ca2ef1f69 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:00.798870 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df3cc1-d6c1-45e5-8e4e-b46371a657b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:00.799517 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df3cc1-d6c1-45e5-8e4e-b46371a657b5 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.800011 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df3cc1-d6c1-45e5-8e4e-b46371a657b5 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.800123 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df3cc1-d6c1-45e5-8e4e-b46371a657b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.806779 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df3cc1-d6c1-45e5-8e4e-b46371a657b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:00.808202 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df3cc1-d6c1-45e5-8e4e-b46371a657b5 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:00.816705 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e24b49-24f3-4c9d-a285-518af422b840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:00.817380 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e24b49-24f3-4c9d-a285-518af422b840 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.817666 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e24b49-24f3-4c9d-a285-518af422b840 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.817966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e24b49-24f3-4c9d-a285-518af422b840 None admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.818658 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e24b49-24f3-4c9d-a285-518af422b840 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:00.818946 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e24b49-24f3-4c9d-a285-518af422b840 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:00.819719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-42df3cc1-d6c1-45e5-8e4e-b46371a657b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:34:00.819719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:00.819719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:00.819719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:00.819719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:00.819719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:00.819719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:00.819719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:00.819719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:00.819719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:00.819719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:00.819719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:00.819719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:34:00.819719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:34:00.819719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:00.820563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:00.826642 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:34:00.826642 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:34:00.826642 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:34:00.826642 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:34:00.826642 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:34:00.826642 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:34:00.826642 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:34:00.826642 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:00.827087 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e24b49-24f3-4c9d-a285-518af422b840 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:00.827158 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 319/634] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:00.827158 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df3cc1-d6c1-45e5-8e4e-b46371a657b5 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:00.838203 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 316/635] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:00.843492 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e24b49-24f3-4c9d-a285-518af422b840 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:00.924845 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:00.932498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df3cc1-d6c1-45e5-8e4e-b46371a657b5 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:00.946886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e24b49-24f3-4c9d-a285-518af422b840 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:00.969241 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c09ad-c99e-4b67-9b7c-9ba22f33417c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:00.970169 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c09ad-c99e-4b67-9b7c-9ba22f33417c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.970687 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c09ad-c99e-4b67-9b7c-9ba22f33417c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.971131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c09ad-c99e-4b67-9b7c-9ba22f33417c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.972018 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c09ad-c99e-4b67-9b7c-9ba22f33417c None admin] RBAC: Adding query filter params (role.id=b849f9edba724fe5a0d7d1e8da249400, scope.project.id=bac7915cef1d4e3288a30fd015fcce50, user.id=7210700b41444499b0a6cfe978445247) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:00.972520 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c09ad-c99e-4b67-9b7c-9ba22f33417c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:00.974128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c09ad-c99e-4b67-9b7c-9ba22f33417c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:00.980291 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 320/636] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:00 2022] GET /identity/v3/role_assignments?user.id=7210700b41444499b0a6cfe978445247&scope.project.id=bac7915cef1d4e3288a30fd015fcce50&role.id=b849f9edba724fe5a0d7d1e8da249400 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:00.981114 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c09ad-c99e-4b67-9b7c-9ba22f33417c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:00.992573 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a84069-721b-4a1c-ae55-fbecd8ef0d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:00.993563 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a84069-721b-4a1c-ae55-fbecd8ef0d26 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:00.994063 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a84069-721b-4a1c-ae55-fbecd8ef0d26 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:00.994522 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a84069-721b-4a1c-ae55-fbecd8ef0d26 None admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:00.995280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a84069-721b-4a1c-ae55-fbecd8ef0d26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:00.995597 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a84069-721b-4a1c-ae55-fbecd8ef0d26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:00.997067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a84069-721b-4a1c-ae55-fbecd8ef0d26 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:00.999196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:01.013929 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 317/637] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:01.022481 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a84069-721b-4a1c-ae55-fbecd8ef0d26 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:01.113210 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c09ad-c99e-4b67-9b7c-9ba22f33417c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:01.147027 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a84069-721b-4a1c-ae55-fbecd8ef0d26 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:01.150974 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23261d-7c15-4fe8-91ff-9753f962bafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:01.151750 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23261d-7c15-4fe8-91ff-9753f962bafb None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:01.152131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23261d-7c15-4fe8-91ff-9753f962bafb None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:01.152522 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23261d-7c15-4fe8-91ff-9753f962bafb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:01.153360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23261d-7c15-4fe8-91ff-9753f962bafb None admin] RBAC: Adding query filter params (role.id=b849f9edba724fe5a0d7d1e8da249400, scope.project.id=bac7915cef1d4e3288a30fd015fcce50, user.id=e2efb666066f4caaa7353656984b5bcd) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:01.153771 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23261d-7c15-4fe8-91ff-9753f962bafb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:01.155371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23261d-7c15-4fe8-91ff-9753f962bafb None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:01.162909 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 321/638] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:00 2022] GET /identity/v3/role_assignments?user.id=e2efb666066f4caaa7353656984b5bcd&scope.project.id=bac7915cef1d4e3288a30fd015fcce50&role.id=b849f9edba724fe5a0d7d1e8da249400 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:01.164324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ded223-2a1c-4306-958b-426fe15c3a97 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:01.164682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ded223-2a1c-4306-958b-426fe15c3a97 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:01.165031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ded223-2a1c-4306-958b-426fe15c3a97 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:01.170839 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 322/639] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:01.172524 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6484d-1658-4ef3-873a-34a4b8b8dccb None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:01.174464 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6484d-1658-4ef3-873a-34a4b8b8dccb None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:01.178735 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6484d-1658-4ef3-873a-34a4b8b8dccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:01.203552 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d5797-8336-423d-bfc1-2ef3d9ef0fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:01.203792 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-10b6484d-1658-4ef3-873a-34a4b8b8dccb None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:01.204597 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5797-8336-423d-bfc1-2ef3d9ef0fc7 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:01.205050 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5797-8336-423d-bfc1-2ef3d9ef0fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:01.205431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-10b6484d-1658-4ef3-873a-34a4b8b8dccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:01.205958 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5797-8336-423d-bfc1-2ef3d9ef0fc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:01.207249 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d5797-8336-423d-bfc1-2ef3d9ef0fc7 None admin] RBAC: Adding query filter params (role.id=b849f9edba724fe5a0d7d1e8da249400, scope.project.id=bac7915cef1d4e3288a30fd015fcce50, user.id=98b1f2e36ec948eabeb7c0c1bdf87216) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:01.207736 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d5797-8336-423d-bfc1-2ef3d9ef0fc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:01.209700 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d5797-8336-423d-bfc1-2ef3d9ef0fc7 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:01.221916 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 318/640] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:01 2022] GET /identity/v3/role_assignments?user.id=98b1f2e36ec948eabeb7c0c1bdf87216&scope.project.id=bac7915cef1d4e3288a30fd015fcce50&role.id=b849f9edba724fe5a0d7d1e8da249400 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:01.233733 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:01.304031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 323/641] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:01.641011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d5797-8336-423d-bfc1-2ef3d9ef0fc7 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:01.704307 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:01.749251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d5797-8336-423d-bfc1-2ef3d9ef0fc7 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:01.783238 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388de72-bda6-44a0-b44b-46edf70145fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:01.784389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388de72-bda6-44a0-b44b-46edf70145fc None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:01.784701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388de72-bda6-44a0-b44b-46edf70145fc None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:01.784929 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388de72-bda6-44a0-b44b-46edf70145fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:01.795367 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388de72-bda6-44a0-b44b-46edf70145fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-b388de72-bda6-44a0-b44b-46edf70145fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:01.800928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:01.802011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:01.803523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:01.803523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:01.803523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:01.803523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:01.803523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:01.803523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:01.803523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:01.803523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:01.803523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:01.803523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:01.803523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:01.803523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:01.803523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 319/642] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:01.808137 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6484d-1658-4ef3-873a-34a4b8b8dccb None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:01.916312 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6484d-1658-4ef3-873a-34a4b8b8dccb None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:01.951976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771184f8-3991-4192-b6fb-02cf567d121a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:01.952596 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771184f8-3991-4192-b6fb-02cf567d121a None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:01.952885 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771184f8-3991-4192-b6fb-02cf567d121a None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:01.953160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771184f8-3991-4192-b6fb-02cf567d121a None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:01.953823 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771184f8-3991-4192-b6fb-02cf567d121a None admin] RBAC: Adding query filter params (name=admin) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:01.954156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771184f8-3991-4192-b6fb-02cf567d121a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:01.955656 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771184f8-3991-4192-b6fb-02cf567d121a None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:01.964712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 324/643] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:01.970336 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388de72-bda6-44a0-b44b-46edf70145fc None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:02.072728 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388de72-bda6-44a0-b44b-46edf70145fc None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:02.089791 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:02.106833 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38d540-fe19-4b3a-9924-db2949f96a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:02.107460 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38d540-fe19-4b3a-9924-db2949f96a3a None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:02.107739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38d540-fe19-4b3a-9924-db2949f96a3a None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:02.108072 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38d540-fe19-4b3a-9924-db2949f96a3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:02.119819 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38d540-fe19-4b3a-9924-db2949f96a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:02.121253 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38d540-fe19-4b3a-9924-db2949f96a3a None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-5c38d540-fe19-4b3a-9924-db2949f96a3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:34:02.135553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:02.136505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:34:02.138000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:34:02.138000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:02.138000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:02.138000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 320/644] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:02.142288 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771184f8-3991-4192-b6fb-02cf567d121a None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:02.162246 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:02.252180 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771184f8-3991-4192-b6fb-02cf567d121a None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:02.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b500a-0097-45d1-a670-0478acac4032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:02.287787 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b500a-0097-45d1-a670-0478acac4032 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:02.288069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b500a-0097-45d1-a670-0478acac4032 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:02.288345 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b500a-0097-45d1-a670-0478acac4032 None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:02.288989 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b500a-0097-45d1-a670-0478acac4032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:02.289293 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b500a-0097-45d1-a670-0478acac4032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:02.290671 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b500a-0097-45d1-a670-0478acac4032 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:02.303957 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 325/645] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:02.309399 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38d540-fe19-4b3a-9924-db2949f96a3a None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:02.422081 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38d540-fe19-4b3a-9924-db2949f96a3a None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:02.457572 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83427e0b-ac51-4e3c-acc4-40eb9bd6dcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:02.458243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83427e0b-ac51-4e3c-acc4-40eb9bd6dcb1 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:02.458524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83427e0b-ac51-4e3c-acc4-40eb9bd6dcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:02.458802 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83427e0b-ac51-4e3c-acc4-40eb9bd6dcb1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:02.467202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83427e0b-ac51-4e3c-acc4-40eb9bd6dcb1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:02.468681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83427e0b-ac51-4e3c-acc4-40eb9bd6dcb1 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-83427e0b-ac51-4e3c-acc4-40eb9bd6dcb1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:34:02.482329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:02.483604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:02.485161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:02.485161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:02.485161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:34:02.485161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:34:02.485161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:34:02.485161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:34:02.485161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:34:02.485161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:34:02.485161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:34:02.485161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:02.485161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 321/646] 10.222.0.36 () {56 vars in 1093 bytes} [Sat Oct 8 20:34:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:02.489696 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b500a-0097-45d1-a670-0478acac4032 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:02.569400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:02.593230 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b500a-0097-45d1-a670-0478acac4032 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:02.634660 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27584c65-2cd7-4e84-8e63-b54f9272f01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:02.635275 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27584c65-2cd7-4e84-8e63-b54f9272f01f None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:02.635562 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27584c65-2cd7-4e84-8e63-b54f9272f01f None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:02.635837 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27584c65-2cd7-4e84-8e63-b54f9272f01f None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:02.636564 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27584c65-2cd7-4e84-8e63-b54f9272f01f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:02.636871 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27584c65-2cd7-4e84-8e63-b54f9272f01f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:02.638386 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27584c65-2cd7-4e84-8e63-b54f9272f01f None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:02.657363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 326/647] 10.222.0.36 () {56 vars in 1133 bytes} [Sat Oct 8 20:34:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:02.663282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83427e0b-ac51-4e3c-acc4-40eb9bd6dcb1 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:02.702083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:02.777051 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83427e0b-ac51-4e3c-acc4-40eb9bd6dcb1 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:02.811730 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859caf2c-8624-444d-8194-62bc6192966e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:02.812340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859caf2c-8624-444d-8194-62bc6192966e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:02.812693 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859caf2c-8624-444d-8194-62bc6192966e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:02.812972 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859caf2c-8624-444d-8194-62bc6192966e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:02.883225 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859caf2c-8624-444d-8194-62bc6192966e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:02.884632 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859caf2c-8624-444d-8194-62bc6192966e None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:02.915770 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:02.990714 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 322/648] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 08 20:34:02.996266 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27584c65-2cd7-4e84-8e63-b54f9272f01f None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:03.119000 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27584c65-2cd7-4e84-8e63-b54f9272f01f None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:03.155870 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efb495-3b80-4db1-924f-c31b708e6677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:03.156888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efb495-3b80-4db1-924f-c31b708e6677 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.157398 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efb495-3b80-4db1-924f-c31b708e6677 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.157875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efb495-3b80-4db1-924f-c31b708e6677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.161426 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:03.171512 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efb495-3b80-4db1-924f-c31b708e6677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:03.173138 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efb495-3b80-4db1-924f-c31b708e6677 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-75efb495-3b80-4db1-924f-c31b708e6677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:34:03.191385 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:03.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:34:03.193924 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:34:03.193924 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:03.193924 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:03.193924 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 327/649] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:03.203008 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859caf2c-8624-444d-8194-62bc6192966e None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:03.314263 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859caf2c-8624-444d-8194-62bc6192966e None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:03.344603 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:03.352712 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa167fa2-5fe6-4089-9631-b55ea10c3929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:03.353341 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa167fa2-5fe6-4089-9631-b55ea10c3929 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.353602 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa167fa2-5fe6-4089-9631-b55ea10c3929 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.353875 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa167fa2-5fe6-4089-9631-b55ea10c3929 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.354536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa167fa2-5fe6-4089-9631-b55ea10c3929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:03.354841 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa167fa2-5fe6-4089-9631-b55ea10c3929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:03.356191 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa167fa2-5fe6-4089-9631-b55ea10c3929 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:03.368725 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 323/650] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:03.373916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efb495-3b80-4db1-924f-c31b708e6677 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:03.484848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efb495-3b80-4db1-924f-c31b708e6677 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:03.522450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b882b-64af-4e4c-b112-5da272e8e860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:03.523077 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b882b-64af-4e4c-b112-5da272e8e860 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.523359 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b882b-64af-4e4c-b112-5da272e8e860 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.523635 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b882b-64af-4e4c-b112-5da272e8e860 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.530555 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b882b-64af-4e4c-b112-5da272e8e860 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:03.531987 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b882b-64af-4e4c-b112-5da272e8e860 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:03.543698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-be0b882b-64af-4e4c-b112-5da272e8e860 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:34:03.543698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:03.543698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:03.543698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:03.543698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:03.543698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:03.543698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:03.543698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:03.543698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:03.543698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:03.543698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:03.543698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:03.543698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:34:03.543698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:34:03.543698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:03.544603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:03.545992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:34:03.545992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:34:03.545992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:34:03.545992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:34:03.545992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:34:03.545992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:34:03.545992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:34:03.545992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:03.545992 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 328/651] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:03.551182 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa167fa2-5fe6-4089-9631-b55ea10c3929 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:03.621868 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdee8d-aaf3-4437-a47e-fbe09184091d None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.622225 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdee8d-aaf3-4437-a47e-fbe09184091d None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.622452 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdee8d-aaf3-4437-a47e-fbe09184091d None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.624032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 329/652] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:03.629377 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61336390-5450-40d5-ad61-d364bef2a4fc None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.629943 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61336390-5450-40d5-ad61-d364bef2a4fc None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.630415 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61336390-5450-40d5-ad61-d364bef2a4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.649652 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-61336390-5450-40d5-ad61-d364bef2a4fc None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:03.651264 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-61336390-5450-40d5-ad61-d364bef2a4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:03.663086 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa167fa2-5fe6-4089-9631-b55ea10c3929 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:03.696960 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:03.704307 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec94518-5207-4b4b-a9af-c251a7c282de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:03.704929 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec94518-5207-4b4b-a9af-c251a7c282de None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.705768 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec94518-5207-4b4b-a9af-c251a7c282de None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.706152 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec94518-5207-4b4b-a9af-c251a7c282de None admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.707128 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec94518-5207-4b4b-a9af-c251a7c282de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:03.707740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec94518-5207-4b4b-a9af-c251a7c282de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:03.709564 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec94518-5207-4b4b-a9af-c251a7c282de None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:03.729507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 324/654] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:34:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:03.729828 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 330/654] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:03.733908 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec94518-5207-4b4b-a9af-c251a7c282de None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:03.757474 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bece2e3-9957-4d87-904c-3513d3b3128a None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.758111 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bece2e3-9957-4d87-904c-3513d3b3128a None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.758590 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bece2e3-9957-4d87-904c-3513d3b3128a None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.760361 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 331/655] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:03.765140 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e904f9-ce42-4667-a406-c25e31fea64b None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.765429 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e904f9-ce42-4667-a406-c25e31fea64b None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.765706 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e904f9-ce42-4667-a406-c25e31fea64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.784545 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-76e904f9-ce42-4667-a406-c25e31fea64b None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:03.785721 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-76e904f9-ce42-4667-a406-c25e31fea64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:03.789982 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:03.843338 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec94518-5207-4b4b-a9af-c251a7c282de None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:03.866314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 332/656] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:03.882886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8060a9-592a-4e17-a314-3edd2f2f7406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:03.883499 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8060a9-592a-4e17-a314-3edd2f2f7406 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.883782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8060a9-592a-4e17-a314-3edd2f2f7406 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.884057 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8060a9-592a-4e17-a314-3edd2f2f7406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.884778 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8060a9-592a-4e17-a314-3edd2f2f7406 None admin] RBAC: Adding query filter params (role.id=323ca657fe7b4b878fd8328ef78f29f4, scope.project.id=bac7915cef1d4e3288a30fd015fcce50, user.id=017db52cc36f4bdb9448afe74edab753) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:03.885150 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8060a9-592a-4e17-a314-3edd2f2f7406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:03.886604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8060a9-592a-4e17-a314-3edd2f2f7406 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:03.892313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 325/657] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:03 2022] GET /identity/v3/role_assignments?user.id=017db52cc36f4bdb9448afe74edab753&scope.project.id=bac7915cef1d4e3288a30fd015fcce50&role.id=323ca657fe7b4b878fd8328ef78f29f4 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:03.894433 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e54400-ee96-45a2-b3d3-46bd9848c24b None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.894722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e54400-ee96-45a2-b3d3-46bd9848c24b None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.894994 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e54400-ee96-45a2-b3d3-46bd9848c24b None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.896471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 333/658] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:34:03.902365 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7d596-d80e-45f3-bbec-8eb8094b413d None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:03.902652 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7d596-d80e-45f3-bbec-8eb8094b413d None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:03.902933 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7d596-d80e-45f3-bbec-8eb8094b413d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:03.923238 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-efd7d596-d80e-45f3-bbec-8eb8094b413d None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:03.924725 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-efd7d596-d80e-45f3-bbec-8eb8094b413d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:04.001855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 326/659] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 08 20:34:04.072825 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e54400-ee96-45a2-b3d3-46bd9848c24b None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:04.186677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e54400-ee96-45a2-b3d3-46bd9848c24b None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:04.195902 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:04.204618 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7d596-d80e-45f3-bbec-8eb8094b413d None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:04.239042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d5ef9-f125-4404-91f1-675e8b24449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:04.240133 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d5ef9-f125-4404-91f1-675e8b24449e None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:04.240415 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d5ef9-f125-4404-91f1-675e8b24449e None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:04.240951 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d5ef9-f125-4404-91f1-675e8b24449e None admin] PATH_INFO: `/v3/services/image` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:04.241536 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d5ef9-f125-4404-91f1-675e8b24449e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:04.243719 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d5ef9-f125-4404-91f1-675e8b24449e None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-900d5ef9-f125-4404-91f1-675e8b24449e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:04.256820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:04.259160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:04.261141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:04.261141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:04.261141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:04.261141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:04.261141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:04.261141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:04.261141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:04.261141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:04.261141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:04.261141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:04.261141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:04.261141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:04.261141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:34:04.261141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:04.261141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 334/660] 10.222.0.36 () {56 vars in 1105 bytes} [Sat Oct 8 20:34:04 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:04.267244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d5ef9-f125-4404-91f1-675e8b24449e None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:04.270081 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:04.347581 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7d596-d80e-45f3-bbec-8eb8094b413d None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:04.382676 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d5ef9-f125-4404-91f1-675e8b24449e None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:04.383091 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d091c-134c-4de2-bb90-8c2f62533d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:04.383730 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d091c-134c-4de2-bb90-8c2f62533d04 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:04.384020 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d091c-134c-4de2-bb90-8c2f62533d04 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:04.384295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d091c-134c-4de2-bb90-8c2f62533d04 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:04.384872 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d091c-134c-4de2-bb90-8c2f62533d04 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:04.386263 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d091c-134c-4de2-bb90-8c2f62533d04 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-788d091c-134c-4de2-bb90-8c2f62533d04 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:04.398290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:04.399317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:04.400171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:04.400171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:04.400171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:04.400171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:04.400171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:04.400171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:04.400171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:04.400171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:04.400171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:04.400171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:04.400171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:04.400171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:04.400171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:34:04.400171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:04.400171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 327/661] 10.222.0.36 () {56 vars in 1129 bytes} [Sat Oct 8 20:34:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:04.400983 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d091c-134c-4de2-bb90-8c2f62533d04 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:04.424013 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6bf60-54b2-48ba-9344-2bee90c4d3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:04.425621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6bf60-54b2-48ba-9344-2bee90c4d3c9 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:04.426168 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6bf60-54b2-48ba-9344-2bee90c4d3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:04.426656 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6bf60-54b2-48ba-9344-2bee90c4d3c9 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:04.427386 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6bf60-54b2-48ba-9344-2bee90c4d3c9 None admin] RBAC: Adding query filter params (name=image) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:04.427698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6bf60-54b2-48ba-9344-2bee90c4d3c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:04.429051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6bf60-54b2-48ba-9344-2bee90c4d3c9 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:04.439019 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 335/662] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:04.439391 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6bf60-54b2-48ba-9344-2bee90c4d3c9 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:04.477105 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:04.508555 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d091c-134c-4de2-bb90-8c2f62533d04 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:04.519414 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:04.547309 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb366a8-981b-4189-94de-9a7f70c33a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:04.548014 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6bf60-54b2-48ba-9344-2bee90c4d3c9 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:04.548481 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb366a8-981b-4189-94de-9a7f70c33a25 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:04.549455 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb366a8-981b-4189-94de-9a7f70c33a25 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:04.549928 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb366a8-981b-4189-94de-9a7f70c33a25 None admin] PATH_INFO: `/v3/services/network` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:04.550677 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb366a8-981b-4189-94de-9a7f70c33a25 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:04.552249 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb366a8-981b-4189-94de-9a7f70c33a25 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-cfb366a8-981b-4189-94de-9a7f70c33a25 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:04.561495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:04.562546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:04.563404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:04.563404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:04.563404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:04.563404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:04.563404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:04.563404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:04.563404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:04.563404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:04.563404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:04.563404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:04.563404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:04.563404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:04.563404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:34:04.563404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:04.566503 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 328/663] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:04 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:04.567489 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb366a8-981b-4189-94de-9a7f70c33a25 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:04.588759 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ade684-b041-445e-8ac1-61ea5706e130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:04.589363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ade684-b041-445e-8ac1-61ea5706e130 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:04.589641 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ade684-b041-445e-8ac1-61ea5706e130 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:04.589944 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ade684-b041-445e-8ac1-61ea5706e130 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:04.590570 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ade684-b041-445e-8ac1-61ea5706e130 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:04.590873 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ade684-b041-445e-8ac1-61ea5706e130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:04.592220 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ade684-b041-445e-8ac1-61ea5706e130 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:04.596868 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 336/664] 10.222.0.36 () {56 vars in 1124 bytes} [Sat Oct 8 20:34:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:04.597545 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ade684-b041-445e-8ac1-61ea5706e130 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:04.683100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb366a8-981b-4189-94de-9a7f70c33a25 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:04.693479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:04.697384 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ade684-b041-445e-8ac1-61ea5706e130 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:04.723470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a322e54-3b1d-42c7-9e3e-53cc911fdff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:04.724198 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a322e54-3b1d-42c7-9e3e-53cc911fdff8 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:04.724625 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a322e54-3b1d-42c7-9e3e-53cc911fdff8 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:04.724900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a322e54-3b1d-42c7-9e3e-53cc911fdff8 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:04.725518 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a322e54-3b1d-42c7-9e3e-53cc911fdff8 None admin] RBAC: Adding query filter params (type=image) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:04.725852 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a322e54-3b1d-42c7-9e3e-53cc911fdff8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:04.727357 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a322e54-3b1d-42c7-9e3e-53cc911fdff8 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:04.732122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31467-f98e-4b4e-bbc0-e312c102e624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:04.732732 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31467-f98e-4b4e-bbc0-e312c102e624 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:04.733008 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31467-f98e-4b4e-bbc0-e312c102e624 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:04.733565 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 329/665] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:04.734399 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a322e54-3b1d-42c7-9e3e-53cc911fdff8 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:04.744572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31467-f98e-4b4e-bbc0-e312c102e624 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:04.745284 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d31467-f98e-4b4e-bbc0-e312c102e624 None admin] RBAC: Adding query filter params (name=network) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:04.745599 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d31467-f98e-4b4e-bbc0-e312c102e624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:04.747086 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d31467-f98e-4b4e-bbc0-e312c102e624 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:04.753264 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 337/666] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Oct 8 20:34:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:04.758648 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31467-f98e-4b4e-bbc0-e312c102e624 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:04.781977 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:04.858729 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a322e54-3b1d-42c7-9e3e-53cc911fdff8 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:04.879678 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31467-f98e-4b4e-bbc0-e312c102e624 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:04.900752 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347c650-8e9e-43c1-a736-a18f2520da22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:04.901780 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c650-8e9e-43c1-a736-a18f2520da22 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:04.902164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c650-8e9e-43c1-a736-a18f2520da22 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:04.902667 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c650-8e9e-43c1-a736-a18f2520da22 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:04.903379 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347c650-8e9e-43c1-a736-a18f2520da22 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:04.903752 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347c650-8e9e-43c1-a736-a18f2520da22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:04.905328 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347c650-8e9e-43c1-a736-a18f2520da22 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:04.918362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 330/667] 10.222.0.36 () {56 vars in 1124 bytes} [Sat Oct 8 20:34:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:04.925508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e21368-d844-45c8-aafe-ccef6197f20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:04.926626 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e21368-d844-45c8-aafe-ccef6197f20f None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:04.927371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e21368-d844-45c8-aafe-ccef6197f20f None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:04.927854 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e21368-d844-45c8-aafe-ccef6197f20f None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:04.928707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e21368-d844-45c8-aafe-ccef6197f20f None admin] RBAC: Adding query filter params (type=network) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:04.929242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e21368-d844-45c8-aafe-ccef6197f20f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:04.930897 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e21368-d844-45c8-aafe-ccef6197f20f None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:04.938618 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 338/668] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Oct 8 20:34:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:06.420493 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4d6a8-d5ce-4ffa-82d0-64c9b7e0795c None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:06.420985 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4d6a8-d5ce-4ffa-82d0-64c9b7e0795c None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:06.420985 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4d6a8-d5ce-4ffa-82d0-64c9b7e0795c None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:06.422596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 331/669] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:06.428284 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1b82b-1edf-4115-bc0b-d130065abb1b None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:06.428692 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1b82b-1edf-4115-bc0b-d130065abb1b None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:06.428882 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1b82b-1edf-4115-bc0b-d130065abb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:06.447748 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-62e1b82b-1edf-4115-bc0b-d130065abb1b None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:06.448936 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-62e1b82b-1edf-4115-bc0b-d130065abb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:06.469569 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:06.521371 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 339/670] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:06.853757 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4d6a8-d5ce-4ffa-82d0-64c9b7e0795c None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:06.958477 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:06.962995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4d6a8-d5ce-4ffa-82d0-64c9b7e0795c None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:07.003262 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234aa2e-76fd-44ff-b666-1dafaa6c8353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:07.003919 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234aa2e-76fd-44ff-b666-1dafaa6c8353 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.004201 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234aa2e-76fd-44ff-b666-1dafaa6c8353 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.004474 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234aa2e-76fd-44ff-b666-1dafaa6c8353 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.017102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234aa2e-76fd-44ff-b666-1dafaa6c8353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-9234aa2e-76fd-44ff-b666-1dafaa6c8353 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:07.022415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:07.023445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:07.024673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:07.024673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:07.024673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:07.024673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:07.024673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:07.024673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:07.024673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:07.024673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:07.024673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:07.024673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:07.024673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:07.024673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:07.024673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 332/671] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:34:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:07.029529 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1b82b-1edf-4115-bc0b-d130065abb1b None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:07.133857 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1b82b-1edf-4115-bc0b-d130065abb1b None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:07.171295 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89768bb-9874-469e-9e51-3de2804fe63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:07.172209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89768bb-9874-469e-9e51-3de2804fe63d None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.172662 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89768bb-9874-469e-9e51-3de2804fe63d None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.173123 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89768bb-9874-469e-9e51-3de2804fe63d None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.174607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89768bb-9874-469e-9e51-3de2804fe63d None admin] RBAC: Adding query filter params (name=admin) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:07.175279 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89768bb-9874-469e-9e51-3de2804fe63d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:07.176815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89768bb-9874-469e-9e51-3de2804fe63d None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:07.186178 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 340/672] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:07.192046 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234aa2e-76fd-44ff-b666-1dafaa6c8353 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:07.212667 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64130fb9-caac-45df-826f-4e45e69d0750 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.212945 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64130fb9-caac-45df-826f-4e45e69d0750 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.213216 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64130fb9-caac-45df-826f-4e45e69d0750 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.214910 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 341/673] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:07.220068 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ae807-36bc-4b4a-80d3-f4ee83636559 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.220348 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ae807-36bc-4b4a-80d3-f4ee83636559 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.220646 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ae807-36bc-4b4a-80d3-f4ee83636559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.240617 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-508ae807-36bc-4b4a-80d3-f4ee83636559 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:07.241798 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-508ae807-36bc-4b4a-80d3-f4ee83636559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:07.301645 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234aa2e-76fd-44ff-b666-1dafaa6c8353 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:07.310247 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:07.318575 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 342/674] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:07.344467 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29096ada-79e9-4633-9a3e-e2b9038f9468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:07.345110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29096ada-79e9-4633-9a3e-e2b9038f9468 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.345378 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29096ada-79e9-4633-9a3e-e2b9038f9468 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.345704 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29096ada-79e9-4633-9a3e-e2b9038f9468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.358047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29096ada-79e9-4633-9a3e-e2b9038f9468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:07.359739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29096ada-79e9-4633-9a3e-e2b9038f9468 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-29096ada-79e9-4633-9a3e-e2b9038f9468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:34:07.375484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:07.376457 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:34:07.377553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:34:07.377553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:07.377553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:07.377553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 333/675] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:07.383800 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ae807-36bc-4b4a-80d3-f4ee83636559 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:07.443468 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917b9d4-e403-428b-9720-0089d87ae2f5 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.444076 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917b9d4-e403-428b-9720-0089d87ae2f5 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.444076 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917b9d4-e403-428b-9720-0089d87ae2f5 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.445476 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 334/676] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:07.450998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d20e26-a014-4124-8470-ea60cf28c964 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.451280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d20e26-a014-4124-8470-ea60cf28c964 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.451551 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d20e26-a014-4124-8470-ea60cf28c964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.470570 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-f5d20e26-a014-4124-8470-ea60cf28c964 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:07.471894 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-f5d20e26-a014-4124-8470-ea60cf28c964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:07.480039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:07.488119 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ae807-36bc-4b4a-80d3-f4ee83636559 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:07.523435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a9db3-a3a3-4b4f-9703-d4da809aa9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:07.524036 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a9db3-a3a3-4b4f-9703-d4da809aa9ca None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.524312 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a9db3-a3a3-4b4f-9703-d4da809aa9ca None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.524579 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a9db3-a3a3-4b4f-9703-d4da809aa9ca None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.525209 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a9db3-a3a3-4b4f-9703-d4da809aa9ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:07.525507 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a9db3-a3a3-4b4f-9703-d4da809aa9ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:07.526885 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a9db3-a3a3-4b4f-9703-d4da809aa9ca None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:07.544047 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 343/677] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:07.544047 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6ed1-474f-4947-8ceb-daefbeb49a31 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.544047 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6ed1-474f-4947-8ceb-daefbeb49a31 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.544047 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6ed1-474f-4947-8ceb-daefbeb49a31 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.544047 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 344/678] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:07.544973 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a6ed1-474f-4947-8ceb-daefbeb49a31 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:07.552917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 335/679] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:07.554122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cbcf8-800f-4dd3-a778-1a4ca4b7c846 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.554417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cbcf8-800f-4dd3-a778-1a4ca4b7c846 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.554698 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cbcf8-800f-4dd3-a778-1a4ca4b7c846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.560941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:07.573433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-3e3cbcf8-800f-4dd3-a778-1a4ca4b7c846 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:07.574947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-3e3cbcf8-800f-4dd3-a778-1a4ca4b7c846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:07.659132 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a6ed1-474f-4947-8ceb-daefbeb49a31 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:07.665994 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 336/680] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 08 20:34:07.667562 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cbcf8-800f-4dd3-a778-1a4ca4b7c846 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:07.698305 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5da8f-5c7d-44cd-9dbc-325b8c5c5e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:07.698936 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5da8f-5c7d-44cd-9dbc-325b8c5c5e40 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.699214 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5da8f-5c7d-44cd-9dbc-325b8c5c5e40 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.699482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5da8f-5c7d-44cd-9dbc-325b8c5c5e40 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.707286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5da8f-5c7d-44cd-9dbc-325b8c5c5e40 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:07.708752 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5da8f-5c7d-44cd-9dbc-325b8c5c5e40 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-55d5da8f-5c7d-44cd-9dbc-325b8c5c5e40 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:34:07.723862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:07.724808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:07.725838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:07.725838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:07.725838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:34:07.725838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:34:07.725838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:34:07.725838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:34:07.725838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:34:07.725838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:34:07.725838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:34:07.725838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:07.725838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 345/681] 10.222.0.36 () {56 vars in 1093 bytes} [Sat Oct 8 20:34:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:07.730618 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5da8f-5c7d-44cd-9dbc-325b8c5c5e40 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:07.757611 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:07.787879 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cbcf8-800f-4dd3-a778-1a4ca4b7c846 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:07.810461 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:07.822488 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296637b3-47a3-4004-9562-ab644382047b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:07.823099 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296637b3-47a3-4004-9562-ab644382047b None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.823383 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296637b3-47a3-4004-9562-ab644382047b None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.823656 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296637b3-47a3-4004-9562-ab644382047b None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.824301 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296637b3-47a3-4004-9562-ab644382047b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:07.825643 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296637b3-47a3-4004-9562-ab644382047b None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:07.854135 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 337/682] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Oct 8 20:34:07 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:07.858102 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5da8f-5c7d-44cd-9dbc-325b8c5c5e40 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:07.904845 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcbc85-7f88-4538-8982-8a0396c0e620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:07.905461 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcbc85-7f88-4538-8982-8a0396c0e620 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:07.905787 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcbc85-7f88-4538-8982-8a0396c0e620 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:07.906098 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcbc85-7f88-4538-8982-8a0396c0e620 None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:07.906821 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcbc85-7f88-4538-8982-8a0396c0e620 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:07.907132 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcbc85-7f88-4538-8982-8a0396c0e620 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:07.909110 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcbc85-7f88-4538-8982-8a0396c0e620 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:07.910762 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296637b3-47a3-4004-9562-ab644382047b None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:07.930471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 346/683] 10.222.0.36 () {56 vars in 1133 bytes} [Sat Oct 8 20:34:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:07.936545 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcbc85-7f88-4538-8982-8a0396c0e620 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:08.042511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296637b3-47a3-4004-9562-ab644382047b None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:08.070820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcbc85-7f88-4538-8982-8a0396c0e620 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:08.081611 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:08.088870 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79690f-3ef2-4a7a-a239-bf76450e794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:08.089483 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79690f-3ef2-4a7a-a239-bf76450e794c None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.090201 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79690f-3ef2-4a7a-a239-bf76450e794c None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.090201 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79690f-3ef2-4a7a-a239-bf76450e794c None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.090719 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79690f-3ef2-4a7a-a239-bf76450e794c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:08.092075 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79690f-3ef2-4a7a-a239-bf76450e794c None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:08.098433 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:08.114352 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813e6c6-9a12-4282-8c1d-602de908ada2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:08.114571 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 338/684] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Oct 8 20:34:07 2022] POST /identity/v3/services => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:34:08.114671 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813e6c6-9a12-4282-8c1d-602de908ada2 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.114671 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813e6c6-9a12-4282-8c1d-602de908ada2 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.114842 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79690f-3ef2-4a7a-a239-bf76450e794c None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:08.114927 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813e6c6-9a12-4282-8c1d-602de908ada2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.129993 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813e6c6-9a12-4282-8c1d-602de908ada2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:08.131566 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813e6c6-9a12-4282-8c1d-602de908ada2 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-e813e6c6-9a12-4282-8c1d-602de908ada2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:34:08.149587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:08.150655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:34:08.151977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:34:08.151977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:08.151977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:08.151977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 347/685] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:34:08.157670 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813e6c6-9a12-4282-8c1d-602de908ada2 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:08.266701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79690f-3ef2-4a7a-a239-bf76450e794c None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:08.283862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813e6c6-9a12-4282-8c1d-602de908ada2 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:08.308251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf8c38-5bde-49ad-a9c4-b68e732d7099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:08.308795 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf8c38-5bde-49ad-a9c4-b68e732d7099 None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.309078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf8c38-5bde-49ad-a9c4-b68e732d7099 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.309355 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf8c38-5bde-49ad-a9c4-b68e732d7099 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.310054 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf8c38-5bde-49ad-a9c4-b68e732d7099 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:08.311613 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf8c38-5bde-49ad-a9c4-b68e732d7099 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:08.325681 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e10dc2-c838-43bc-8b5d-154efa79d431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:08.326570 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e10dc2-c838-43bc-8b5d-154efa79d431 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.326857 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e10dc2-c838-43bc-8b5d-154efa79d431 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.327256 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e10dc2-c838-43bc-8b5d-154efa79d431 None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.327980 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e10dc2-c838-43bc-8b5d-154efa79d431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:08.328285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e10dc2-c838-43bc-8b5d-154efa79d431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:08.329795 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e10dc2-c838-43bc-8b5d-154efa79d431 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:08.332657 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 339/686] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Oct 8 20:34:08 2022] POST /identity/v3/services => generated 240 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:08.347784 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 348/687] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:08.355491 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf8c38-5bde-49ad-a9c4-b68e732d7099 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:08.424020 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:08.491402 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf8c38-5bde-49ad-a9c4-b68e732d7099 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:08.529847 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c823c-63d7-40f5-9b52-91adce9a8a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:08.530526 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c823c-63d7-40f5-9b52-91adce9a8a8c None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.530808 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c823c-63d7-40f5-9b52-91adce9a8a8c None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.531085 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c823c-63d7-40f5-9b52-91adce9a8a8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.539068 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c823c-63d7-40f5-9b52-91adce9a8a8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:08.540533 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c823c-63d7-40f5-9b52-91adce9a8a8c None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:08.552947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-8c3c823c-63d7-40f5-9b52-91adce9a8a8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:34:08.552947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:08.552947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:08.552947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:08.552947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:08.552947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:08.552947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:08.552947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:08.552947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:08.552947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:08.552947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:08.552947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:08.552947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:34:08.552947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:34:08.552947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:08.553968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:08.554895 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:34:08.554895 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:34:08.554895 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:34:08.554895 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:34:08.554895 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:34:08.554895 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:34:08.554895 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:34:08.554895 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:08.558009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 340/688] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:08.560326 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e10dc2-c838-43bc-8b5d-154efa79d431 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:08.603590 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:08.675766 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e10dc2-c838-43bc-8b5d-154efa79d431 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:08.716686 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6860b-d5dd-44ee-afb7-2345ee4dbbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:08.717295 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6860b-d5dd-44ee-afb7-2345ee4dbbbc None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.717571 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6860b-d5dd-44ee-afb7-2345ee4dbbbc None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.717840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6860b-d5dd-44ee-afb7-2345ee4dbbbc None admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.718562 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6860b-d5dd-44ee-afb7-2345ee4dbbbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:08.718892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6860b-d5dd-44ee-afb7-2345ee4dbbbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:08.720366 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6860b-d5dd-44ee-afb7-2345ee4dbbbc None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:08.737080 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 349/689] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:34:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:08.745764 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c823c-63d7-40f5-9b52-91adce9a8a8c None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:08.912196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c823c-63d7-40f5-9b52-91adce9a8a8c None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:08.915809 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:08.970904 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439d82c-c8eb-4648-9957-14e7143424eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:08.972060 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439d82c-c8eb-4648-9957-14e7143424eb None admin] REQUEST_METHOD: `PUT` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:08.972598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439d82c-c8eb-4648-9957-14e7143424eb None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:08.973076 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439d82c-c8eb-4648-9957-14e7143424eb None admin] PATH_INFO: `/v3/projects/bac7915cef1d4e3288a30fd015fcce50/users/017db52cc36f4bdb9448afe74edab753/roles/323ca657fe7b4b878fd8328ef78f29f4` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:08.976246 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439d82c-c8eb-4648-9957-14e7143424eb None admin] RBAC: Authorizing `identity:create_grant(project_id=bac7915cef1d4e3288a30fd015fcce50, user_id=017db52cc36f4bdb9448afe74edab753, role_id=323ca657fe7b4b878fd8328ef78f29f4)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:08.978964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439d82c-c8eb-4648-9957-14e7143424eb None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:09.000694 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 341/690] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:34:08 2022] PUT /identity/v3/projects/bac7915cef1d4e3288a30fd015fcce50/users/017db52cc36f4bdb9448afe74edab753/roles/323ca657fe7b4b878fd8328ef78f29f4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:34:10.419473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf710ef-ef0d-45f2-837d-380bf41149bc None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:10.419978 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf710ef-ef0d-45f2-837d-380bf41149bc None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:10.419978 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf710ef-ef0d-45f2-837d-380bf41149bc None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:10.421533 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 350/691] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:10.427673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404e3a3-8d41-463e-b8a7-c76f0af668d4 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:10.428154 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404e3a3-8d41-463e-b8a7-c76f0af668d4 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:10.428367 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404e3a3-8d41-463e-b8a7-c76f0af668d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:10.448060 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-1404e3a3-8d41-463e-b8a7-c76f0af668d4 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:10.449282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-1404e3a3-8d41-463e-b8a7-c76f0af668d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:10.523840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 342/692] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:10 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:10.847232 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf710ef-ef0d-45f2-837d-380bf41149bc None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:10.890241 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce87436-b35c-4206-870d-3fc74f714f6e None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:10.890876 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce87436-b35c-4206-870d-3fc74f714f6e None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:10.891461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce87436-b35c-4206-870d-3fc74f714f6e None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:10.893437 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 343/693] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:10.898899 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9471658-e236-4564-94d8-a5f7742c34b2 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:10.899264 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9471658-e236-4564-94d8-a5f7742c34b2 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:10.899616 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9471658-e236-4564-94d8-a5f7742c34b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:10.919217 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-f9471658-e236-4564-94d8-a5f7742c34b2 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:10.920764 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-f9471658-e236-4564-94d8-a5f7742c34b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:10.949579 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:10.958150 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf710ef-ef0d-45f2-837d-380bf41149bc None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:10.994987 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019ec8c-5ad9-42b1-b310-24cc9155cbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:10.995646 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019ec8c-5ad9-42b1-b310-24cc9155cbc6 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:10.995893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019ec8c-5ad9-42b1-b310-24cc9155cbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:10.996169 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019ec8c-5ad9-42b1-b310-24cc9155cbc6 None admin] PATH_INFO: `/v3/services/image` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:10.996744 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019ec8c-5ad9-42b1-b310-24cc9155cbc6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:11.002062 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 344/694] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:10 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:34:11.002242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019ec8c-5ad9-42b1-b310-24cc9155cbc6 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:11.002350 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc9feb-30dc-49e3-a905-6d001be32f85 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:11.002350 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc9feb-30dc-49e3-a905-6d001be32f85 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:11.002350 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc9feb-30dc-49e3-a905-6d001be32f85 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:11.002350 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 345/695] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:11.006488 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16f0e0-3d96-45be-8e36-f1f3c7c10626 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:11.006770 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16f0e0-3d96-45be-8e36-f1f3c7c10626 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:11.007189 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16f0e0-3d96-45be-8e36-f1f3c7c10626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-a019ec8c-5ad9-42b1-b310-24cc9155cbc6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:11.012860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:11.014101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:11.014964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:11.014964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:11.014964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:11.014964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:11.014964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:11.014964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:11.014964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:11.014964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:11.014964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:11.014964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:11.014964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:11.014964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:11.014964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:34:11.014964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:11.018661 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 351/696] 10.222.0.36 () {56 vars in 1105 bytes} [Sat Oct 8 20:34:10 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:11.027376 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019ec8c-5ad9-42b1-b310-24cc9155cbc6 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:11.032293 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-9b16f0e0-3d96-45be-8e36-f1f3c7c10626 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:11.034214 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-9b16f0e0-3d96-45be-8e36-f1f3c7c10626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:11.058856 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:11.126187 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 346/697] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:11 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:11.178838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019ec8c-5ad9-42b1-b310-24cc9155cbc6 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:11.214513 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0708b-d951-40db-bd70-4cef2b50d706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:11.215123 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0708b-d951-40db-bd70-4cef2b50d706 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:11.215403 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0708b-d951-40db-bd70-4cef2b50d706 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:11.215676 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0708b-d951-40db-bd70-4cef2b50d706 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:11.216302 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0708b-d951-40db-bd70-4cef2b50d706 None admin] RBAC: Adding query filter params (name=image) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:11.216604 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0708b-d951-40db-bd70-4cef2b50d706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:11.217977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0708b-d951-40db-bd70-4cef2b50d706 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:11.223391 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 352/698] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:11.228961 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16f0e0-3d96-45be-8e36-f1f3c7c10626 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:11.333399 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16f0e0-3d96-45be-8e36-f1f3c7c10626 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:11.338572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0708b-d951-40db-bd70-4cef2b50d706 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:11.370429 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:11.377774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c329e06-fc1f-466f-97ee-b18454834a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:11.378880 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329e06-fc1f-466f-97ee-b18454834a28 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:11.379164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329e06-fc1f-466f-97ee-b18454834a28 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:11.379439 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329e06-fc1f-466f-97ee-b18454834a28 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:11.380084 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c329e06-fc1f-466f-97ee-b18454834a28 None admin] RBAC: Adding query filter params (type=image) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:11.380444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c329e06-fc1f-466f-97ee-b18454834a28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:11.381784 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c329e06-fc1f-466f-97ee-b18454834a28 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:11.387407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 347/699] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:11.394998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c329e06-fc1f-466f-97ee-b18454834a28 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:11.420850 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:11.465236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0708b-d951-40db-bd70-4cef2b50d706 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:11.501291 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e4ff5-48c4-4ac4-86ef-2638a224bf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:11.502947 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e4ff5-48c4-4ac4-86ef-2638a224bf6e None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:11.503500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e4ff5-48c4-4ac4-86ef-2638a224bf6e None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:11.503846 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e4ff5-48c4-4ac4-86ef-2638a224bf6e None admin] PATH_INFO: `/v3/services/network` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:11.504438 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e4ff5-48c4-4ac4-86ef-2638a224bf6e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:11.505795 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e4ff5-48c4-4ac4-86ef-2638a224bf6e None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-2f8e4ff5-48c4-4ac4-86ef-2638a224bf6e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:11.514459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:11.519400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:11.519400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:11.519400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:11.519400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:11.519400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:11.519400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:11.519400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:11.519400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:11.519400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:11.519400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:11.519400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:11.519400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:11.519400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:34:11.519400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:11.519400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 353/700] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:11 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:11.520298 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c329e06-fc1f-466f-97ee-b18454834a28 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:11.520707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e4ff5-48c4-4ac4-86ef-2638a224bf6e None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:11.556718 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da64d7-41a9-4c20-acca-fea9375a3f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:11.557340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da64d7-41a9-4c20-acca-fea9375a3f9e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:11.557622 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da64d7-41a9-4c20-acca-fea9375a3f9e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:11.557921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da64d7-41a9-4c20-acca-fea9375a3f9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:11.558625 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da64d7-41a9-4c20-acca-fea9375a3f9e None admin] RBAC: Adding query filter params (interface=public, service_id=d1132daf6ff340a5b8c0a1bfb594f1be, region_id=RegionOne) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:11.558933 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da64d7-41a9-4c20-acca-fea9375a3f9e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:11.560286 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da64d7-41a9-4c20-acca-fea9375a3f9e None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:11.568276 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 348/701] 10.222.0.36 () {56 vars in 1251 bytes} [Sat Oct 8 20:34:11 2022] GET /identity/v3/endpoints?service_id=d1132daf6ff340a5b8c0a1bfb594f1be&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:11.569059 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da64d7-41a9-4c20-acca-fea9375a3f9e None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:11.608573 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:11.623194 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e4ff5-48c4-4ac4-86ef-2638a224bf6e None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:11.651079 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:11.656353 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bac9fd-f5f6-4b95-a20d-572b99d0900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:11.656974 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bac9fd-f5f6-4b95-a20d-572b99d0900a None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:11.657252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bac9fd-f5f6-4b95-a20d-572b99d0900a None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:11.657526 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bac9fd-f5f6-4b95-a20d-572b99d0900a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:11.658164 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bac9fd-f5f6-4b95-a20d-572b99d0900a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:11.659518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bac9fd-f5f6-4b95-a20d-572b99d0900a None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-28bac9fd-f5f6-4b95-a20d-572b99d0900a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:11.668156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:11.669217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:11.670094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:11.670094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:11.670094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:11.670094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:11.670094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:11.670094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:11.670094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:11.670094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:11.670094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:11.670094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:11.670094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:11.670094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:11.670094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:34:11.670094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:11.670094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 354/702] 10.222.0.36 () {56 vars in 1129 bytes} [Sat Oct 8 20:34:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:11.671227 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da64d7-41a9-4c20-acca-fea9375a3f9e None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:11.671312 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17179dd5-98ba-45e2-8313-f7d4d624621b None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:11.671312 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17179dd5-98ba-45e2-8313-f7d4d624621b None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:11.671448 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17179dd5-98ba-45e2-8313-f7d4d624621b None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:11.677303 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 355/703] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:11.677303 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17179dd5-98ba-45e2-8313-f7d4d624621b None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:11.706835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc144ca7-0a9f-4d6a-b76a-638866bdf17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:11.707436 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc144ca7-0a9f-4d6a-b76a-638866bdf17e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:11.707713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc144ca7-0a9f-4d6a-b76a-638866bdf17e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:11.707979 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc144ca7-0a9f-4d6a-b76a-638866bdf17e None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:11.708596 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc144ca7-0a9f-4d6a-b76a-638866bdf17e None admin] RBAC: Adding query filter params (name=network) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:11.708894 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc144ca7-0a9f-4d6a-b76a-638866bdf17e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:11.710259 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc144ca7-0a9f-4d6a-b76a-638866bdf17e None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:11.714593 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 349/704] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Oct 8 20:34:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:11.715353 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc144ca7-0a9f-4d6a-b76a-638866bdf17e None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:11.780146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17179dd5-98ba-45e2-8313-f7d4d624621b None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:11.811140 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc144ca7-0a9f-4d6a-b76a-638866bdf17e None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:11.812958 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd068177-7820-44a4-8ba3-35f36778860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:11.813557 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd068177-7820-44a4-8ba3-35f36778860b None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:11.813835 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd068177-7820-44a4-8ba3-35f36778860b None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:11.814138 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd068177-7820-44a4-8ba3-35f36778860b None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:11.815326 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd068177-7820-44a4-8ba3-35f36778860b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:11.816672 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd068177-7820-44a4-8ba3-35f36778860b None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:11.822565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 356/705] 10.222.0.36 () {56 vars in 1087 bytes} [Sat Oct 8 20:34:11 2022] GET /identity/v3/services => generated 1002 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:34:11.823513 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0721f7-4f9b-47c0-b719-bf5313fcb16e None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:11.823796 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0721f7-4f9b-47c0-b719-bf5313fcb16e None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:11.824070 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0721f7-4f9b-47c0-b719-bf5313fcb16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:11.848740 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-fa0721f7-4f9b-47c0-b719-bf5313fcb16e None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:11.849994 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-fa0721f7-4f9b-47c0-b719-bf5313fcb16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:11.857465 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ea897-c0df-4c06-93aa-5197d6945a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:11.858381 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ea897-c0df-4c06-93aa-5197d6945a2e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:11.858669 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ea897-c0df-4c06-93aa-5197d6945a2e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:11.858946 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ea897-c0df-4c06-93aa-5197d6945a2e None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:11.859591 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ea897-c0df-4c06-93aa-5197d6945a2e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:11.859899 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ea897-c0df-4c06-93aa-5197d6945a2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:11.860895 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:11.861926 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ea897-c0df-4c06-93aa-5197d6945a2e None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:11.872116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 350/706] 10.222.0.36 () {56 vars in 1124 bytes} [Sat Oct 8 20:34:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:11.872116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ea897-c0df-4c06-93aa-5197d6945a2e None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:11.883915 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:11.936231 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 357/707] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:11 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:11.937399 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0721f7-4f9b-47c0-b719-bf5313fcb16e None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:11.991694 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ea897-c0df-4c06-93aa-5197d6945a2e None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:12.029755 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447c094-409a-4bab-93ff-afa696e53120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:12.030483 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447c094-409a-4bab-93ff-afa696e53120 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.030882 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447c094-409a-4bab-93ff-afa696e53120 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.031216 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447c094-409a-4bab-93ff-afa696e53120 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.031898 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447c094-409a-4bab-93ff-afa696e53120 None admin] RBAC: Adding query filter params (type=network) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:12.032271 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447c094-409a-4bab-93ff-afa696e53120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:12.034832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447c094-409a-4bab-93ff-afa696e53120 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:12.042407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 351/708] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Oct 8 20:34:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:12.047985 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447c094-409a-4bab-93ff-afa696e53120 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:12.086499 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0721f7-4f9b-47c0-b719-bf5313fcb16e None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:12.121971 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08201-a0b6-4d44-a49a-83b578214d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:12.122578 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08201-a0b6-4d44-a49a-83b578214d96 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.122860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08201-a0b6-4d44-a49a-83b578214d96 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.123130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08201-a0b6-4d44-a49a-83b578214d96 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.123767 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08201-a0b6-4d44-a49a-83b578214d96 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:12.124055 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08201-a0b6-4d44-a49a-83b578214d96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:12.125407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08201-a0b6-4d44-a49a-83b578214d96 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:12.130800 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 358/709] 10.222.0.36 () {56 vars in 1124 bytes} [Sat Oct 8 20:34:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:12.135968 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08201-a0b6-4d44-a49a-83b578214d96 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:12.144763 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:12.152800 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:12.181196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447c094-409a-4bab-93ff-afa696e53120 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:12.223016 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11477544-435c-414e-8446-a377881289a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:12.223757 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11477544-435c-414e-8446-a377881289a6 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.224042 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11477544-435c-414e-8446-a377881289a6 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.224316 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11477544-435c-414e-8446-a377881289a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.225724 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11477544-435c-414e-8446-a377881289a6 None admin] RBAC: Adding query filter params (interface=public, service_id=798c7d8df0464939a44dea1d55d045b0, region_id=RegionOne) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:12.225724 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11477544-435c-414e-8446-a377881289a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:12.226811 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11477544-435c-414e-8446-a377881289a6 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:12.232397 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 352/710] 10.222.0.36 () {56 vars in 1251 bytes} [Sat Oct 8 20:34:12 2022] GET /identity/v3/endpoints?service_id=798c7d8df0464939a44dea1d55d045b0&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:12.242926 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11477544-435c-414e-8446-a377881289a6 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:12.263297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08201-a0b6-4d44-a49a-83b578214d96 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:12.300868 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fdfe2-8a78-4e2b-8fb6-7194ba64edb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:12.301793 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fdfe2-8a78-4e2b-8fb6-7194ba64edb1 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.302239 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fdfe2-8a78-4e2b-8fb6-7194ba64edb1 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.302730 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fdfe2-8a78-4e2b-8fb6-7194ba64edb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.303842 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fdfe2-8a78-4e2b-8fb6-7194ba64edb1 None admin] RBAC: Adding query filter params (interface=public, service_id=1985d33d14ea481b9fbea93f08c4fc1e, region_id=RegionOne) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:12.304306 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fdfe2-8a78-4e2b-8fb6-7194ba64edb1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:12.306049 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fdfe2-8a78-4e2b-8fb6-7194ba64edb1 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:12.318739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 359/711] 10.222.0.36 () {56 vars in 1251 bytes} [Sat Oct 8 20:34:12 2022] GET /identity/v3/endpoints?service_id=1985d33d14ea481b9fbea93f08c4fc1e&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:12.319593 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fdfe2-8a78-4e2b-8fb6-7194ba64edb1 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:12.347267 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11477544-435c-414e-8446-a377881289a6 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:12.384312 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fb1f3-a746-4959-9026-1819c880611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:12.384825 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fb1f3-a746-4959-9026-1819c880611d None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.385108 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fb1f3-a746-4959-9026-1819c880611d None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.385456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fb1f3-a746-4959-9026-1819c880611d None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.386009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fb1f3-a746-4959-9026-1819c880611d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:12.387846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fb1f3-a746-4959-9026-1819c880611d None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:12.401915 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 353/712] 10.222.0.36 () {56 vars in 1087 bytes} [Sat Oct 8 20:34:12 2022] GET /identity/v3/services => generated 1002 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:34:12.401915 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fb1f3-a746-4959-9026-1819c880611d None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:12.405090 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:12.412149 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:12.463038 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fdfe2-8a78-4e2b-8fb6-7194ba64edb1 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:12.513000 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd2df9-f386-4494-bda6-d13326a21d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:12.513650 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd2df9-f386-4494-bda6-d13326a21d9b None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.513825 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd2df9-f386-4494-bda6-d13326a21d9b None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.514386 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd2df9-f386-4494-bda6-d13326a21d9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.529462 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd2df9-f386-4494-bda6-d13326a21d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:34:12.536096 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fb1f3-a746-4959-9026-1819c880611d None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-dcfd2df9-f386-4494-bda6-d13326a21d9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:34:12.536712 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:12.537638 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:12.538815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:12.538815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:12.538815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:12.538815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:12.538815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:34:12.538815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:34:12.538815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:34:12.538815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:34:12.538815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:34:12.538815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:34:12.538815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:34:12.538815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:12.542037 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 360/713] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:34:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:12.543789 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd2df9-f386-4494-bda6-d13326a21d9b None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:12.581608 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598d98a-aa87-4e75-8efe-991db754286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:12.582324 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598d98a-aa87-4e75-8efe-991db754286c None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.582609 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598d98a-aa87-4e75-8efe-991db754286c None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.582886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598d98a-aa87-4e75-8efe-991db754286c None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.583502 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598d98a-aa87-4e75-8efe-991db754286c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:12.585099 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598d98a-aa87-4e75-8efe-991db754286c None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:12.598337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 354/714] 10.222.0.36 () {56 vars in 1087 bytes} [Sat Oct 8 20:34:12 2022] GET /identity/v3/services => generated 1002 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:34:12.675578 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd2df9-f386-4494-bda6-d13326a21d9b None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:12.710509 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:12.716445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36b74f-c524-4169-b19a-521ee57860b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:12.717668 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36b74f-c524-4169-b19a-521ee57860b1 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.718474 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36b74f-c524-4169-b19a-521ee57860b1 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.718929 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36b74f-c524-4169-b19a-521ee57860b1 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.720057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36b74f-c524-4169-b19a-521ee57860b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:12.720687 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36b74f-c524-4169-b19a-521ee57860b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:12.722287 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36b74f-c524-4169-b19a-521ee57860b1 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:12.732769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 361/715] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:12.739287 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598d98a-aa87-4e75-8efe-991db754286c None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:12.820050 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:12.854511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598d98a-aa87-4e75-8efe-991db754286c None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:12.889657 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613130f2-9963-445f-922b-45f28f9c7f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:12.890337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613130f2-9963-445f-922b-45f28f9c7f92 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:12.890619 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613130f2-9963-445f-922b-45f28f9c7f92 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:12.890894 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613130f2-9963-445f-922b-45f28f9c7f92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:12.902462 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613130f2-9963-445f-922b-45f28f9c7f92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:12.903885 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613130f2-9963-445f-922b-45f28f9c7f92 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-613130f2-9963-445f-922b-45f28f9c7f92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:34:12.918453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:12.919449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:34:12.920380 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:34:12.920380 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:12.920380 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:12.920380 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 355/716] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:12.925961 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36b74f-c524-4169-b19a-521ee57860b1 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:13.034596 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36b74f-c524-4169-b19a-521ee57860b1 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:13.071193 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a9a87-5966-4087-845d-31c66716b836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:13.071729 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a9a87-5966-4087-845d-31c66716b836 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:13.072013 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a9a87-5966-4087-845d-31c66716b836 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:13.072284 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a9a87-5966-4087-845d-31c66716b836 None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:13.072921 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a9a87-5966-4087-845d-31c66716b836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:13.073217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a9a87-5966-4087-845d-31c66716b836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:13.074600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a9a87-5966-4087-845d-31c66716b836 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:13.087881 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 362/717] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:13.093017 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613130f2-9963-445f-922b-45f28f9c7f92 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:13.199634 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613130f2-9963-445f-922b-45f28f9c7f92 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:13.217605 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:13.236568 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2797771-056f-427a-ae6d-202edce3323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:13.237248 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2797771-056f-427a-ae6d-202edce3323c None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:13.237534 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2797771-056f-427a-ae6d-202edce3323c None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:13.237805 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2797771-056f-427a-ae6d-202edce3323c None admin] PATH_INFO: `/v3/users/nova` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:13.245661 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2797771-056f-427a-ae6d-202edce3323c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:13.247122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2797771-056f-427a-ae6d-202edce3323c None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-a2797771-056f-427a-ae6d-202edce3323c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:34:13.259692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:13.260701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:13.261660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:13.261660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:13.261660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:34:13.261660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:34:13.261660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:34:13.261660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:34:13.261660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:34:13.261660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:34:13.261660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 08 20:34:13.261660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:13.261660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 356/718] 10.222.0.36 () {56 vars in 1093 bytes} [Sat Oct 8 20:34:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:13.266785 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a9a87-5966-4087-845d-31c66716b836 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:13.325440 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:13.371541 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a9a87-5966-4087-845d-31c66716b836 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:13.406043 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da787240-07a2-4927-8146-55e55853324d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:13.406652 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da787240-07a2-4927-8146-55e55853324d None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:13.406926 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da787240-07a2-4927-8146-55e55853324d None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:13.407195 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da787240-07a2-4927-8146-55e55853324d None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:13.408034 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da787240-07a2-4927-8146-55e55853324d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:13.408409 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da787240-07a2-4927-8146-55e55853324d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:13.409818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da787240-07a2-4927-8146-55e55853324d None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:13.428066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 363/719] 10.222.0.36 () {56 vars in 1133 bytes} [Sat Oct 8 20:34:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:13.433357 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2797771-056f-427a-ae6d-202edce3323c None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:13.534025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2797771-056f-427a-ae6d-202edce3323c None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:13.567594 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d53d7-0e67-436e-88d2-55cd1c0c604b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:13.568386 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d53d7-0e67-436e-88d2-55cd1c0c604b None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:13.568563 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d53d7-0e67-436e-88d2-55cd1c0c604b None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:13.568718 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d53d7-0e67-436e-88d2-55cd1c0c604b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:13.626694 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:13.639654 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d53d7-0e67-436e-88d2-55cd1c0c604b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:13.641427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d53d7-0e67-436e-88d2-55cd1c0c604b None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:13.741779 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 357/720] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:13 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:34:13.746998 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da787240-07a2-4927-8146-55e55853324d None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:13.858762 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da787240-07a2-4927-8146-55e55853324d None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:13.873902 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:13.899410 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053f1aa-f068-47bd-a156-3b3157ff9765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:13.899960 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053f1aa-f068-47bd-a156-3b3157ff9765 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:13.900240 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053f1aa-f068-47bd-a156-3b3157ff9765 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:13.900516 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053f1aa-f068-47bd-a156-3b3157ff9765 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:13.910897 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053f1aa-f068-47bd-a156-3b3157ff9765 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:13.912447 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053f1aa-f068-47bd-a156-3b3157ff9765 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-f053f1aa-f068-47bd-a156-3b3157ff9765 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:34:13.927500 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:13.928559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:34:13.930076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:34:13.930076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:13.930076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:13.930076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 364/721] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:34:13.934441 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d53d7-0e67-436e-88d2-55cd1c0c604b None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:14.022259 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:14.043749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d53d7-0e67-436e-88d2-55cd1c0c604b None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:14.079227 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c7a46-15af-40f7-8c1c-94a1acd4eb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:14.079975 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c7a46-15af-40f7-8c1c-94a1acd4eb17 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:14.080252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c7a46-15af-40f7-8c1c-94a1acd4eb17 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:14.080525 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c7a46-15af-40f7-8c1c-94a1acd4eb17 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:14.081158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c7a46-15af-40f7-8c1c-94a1acd4eb17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:14.081460 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c7a46-15af-40f7-8c1c-94a1acd4eb17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:14.082832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c7a46-15af-40f7-8c1c-94a1acd4eb17 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:14.094631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 358/722] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:14.100175 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053f1aa-f068-47bd-a156-3b3157ff9765 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:14.206114 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053f1aa-f068-47bd-a156-3b3157ff9765 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:14.245776 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dce83f-fc59-483d-b27c-0b0784ac464f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:14.246810 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dce83f-fc59-483d-b27c-0b0784ac464f None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:14.247297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dce83f-fc59-483d-b27c-0b0784ac464f None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:14.247799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dce83f-fc59-483d-b27c-0b0784ac464f None admin] PATH_INFO: `/v3/projects/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:14.255084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dce83f-fc59-483d-b27c-0b0784ac464f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:14.256754 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dce83f-fc59-483d-b27c-0b0784ac464f None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:14.269518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-b6dce83f-fc59-483d-b27c-0b0784ac464f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:34:14.269518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:14.269518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:14.269518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:14.269518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:14.269518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:14.269518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:14.269518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:14.269518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:14.269518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:14.269518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:14.269518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:14.269518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:34:14.269518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:34:14.269518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:14.270519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:14.271447 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:34:14.271447 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:34:14.271447 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:34:14.271447 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:34:14.271447 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:34:14.271447 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:34:14.271447 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:34:14.271447 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:14.273905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 365/723] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:14.282483 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c7a46-15af-40f7-8c1c-94a1acd4eb17 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:14.388893 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c7a46-15af-40f7-8c1c-94a1acd4eb17 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:14.424276 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b88019-b5d9-4550-b69b-ff2a677ff7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:14.424889 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b88019-b5d9-4550-b69b-ff2a677ff7eb None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:14.425168 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b88019-b5d9-4550-b69b-ff2a677ff7eb None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:14.425369 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7fade-0358-40f8-9b1a-9922b0ec126e None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:14.425495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b88019-b5d9-4550-b69b-ff2a677ff7eb None admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:14.426004 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7fade-0358-40f8-9b1a-9922b0ec126e None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:14.426178 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b88019-b5d9-4550-b69b-ff2a677ff7eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:14.426448 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b88019-b5d9-4550-b69b-ff2a677ff7eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:14.426830 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7fade-0358-40f8-9b1a-9922b0ec126e None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:14.427855 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b88019-b5d9-4550-b69b-ff2a677ff7eb None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:14.428849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 366/724] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:34:14.434096 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781db97-661b-48cb-9c87-029e194ad788 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:14.434622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781db97-661b-48cb-9c87-029e194ad788 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:14.435120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781db97-661b-48cb-9c87-029e194ad788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:14.435981 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:14.443057 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 359/725] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:34:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:14.450878 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b88019-b5d9-4550-b69b-ff2a677ff7eb None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:14.456356 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-3781db97-661b-48cb-9c87-029e194ad788 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:14.457799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-3781db97-661b-48cb-9c87-029e194ad788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:14.477347 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:14.545918 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 367/726] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:14 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:34:14.577324 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b88019-b5d9-4550-b69b-ff2a677ff7eb None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:14.616869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a715978-9ff1-42f4-b0ff-3f371f60789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:14.617837 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a715978-9ff1-42f4-b0ff-3f371f60789c None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:14.618369 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a715978-9ff1-42f4-b0ff-3f371f60789c None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:14.618879 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a715978-9ff1-42f4-b0ff-3f371f60789c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:14.619772 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a715978-9ff1-42f4-b0ff-3f371f60789c None admin] RBAC: Adding query filter params (role.id=323ca657fe7b4b878fd8328ef78f29f4, scope.project.id=bac7915cef1d4e3288a30fd015fcce50, user.id=017db52cc36f4bdb9448afe74edab753) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:14.620257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a715978-9ff1-42f4-b0ff-3f371f60789c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:14.621828 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a715978-9ff1-42f4-b0ff-3f371f60789c None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:14.628999 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 360/727] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:34:14 2022] GET /identity/v3/role_assignments?user.id=017db52cc36f4bdb9448afe74edab753&scope.project.id=bac7915cef1d4e3288a30fd015fcce50&role.id=323ca657fe7b4b878fd8328ef78f29f4 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:14.888054 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781db97-661b-48cb-9c87-029e194ad788 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:14.994407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781db97-661b-48cb-9c87-029e194ad788 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:15.030510 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d31d4-10cf-48f2-8845-553403c01afb None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:15.030826 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d31d4-10cf-48f2-8845-553403c01afb None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:15.031067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d31d4-10cf-48f2-8845-553403c01afb None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:15.032542 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 361/728] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:34:15.034594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491e7a0-34b5-4997-a92c-7c2ec346ca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:15.035232 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e7a0-34b5-4997-a92c-7c2ec346ca80 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:15.035512 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e7a0-34b5-4997-a92c-7c2ec346ca80 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:15.035787 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e7a0-34b5-4997-a92c-7c2ec346ca80 None admin] PATH_INFO: `/v3/services/image` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:15.036373 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491e7a0-34b5-4997-a92c-7c2ec346ca80 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:15.037738 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491e7a0-34b5-4997-a92c-7c2ec346ca80 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:15.040179 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328d1dd-ee43-4485-932f-b27a44478afa None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:15.040679 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328d1dd-ee43-4485-932f-b27a44478afa None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:15.041149 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328d1dd-ee43-4485-932f-b27a44478afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-3491e7a0-34b5-4997-a92c-7c2ec346ca80 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:15.047213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:15.048201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:15.049844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:15.049844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:15.049844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:15.049844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:15.049844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:15.049844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:15.049844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:15.049844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:15.049844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:15.049844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:15.049844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:15.049844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:15.049844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 08 20:34:15.049844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:15.049844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 368/729] 10.222.0.36 () {56 vars in 1105 bytes} [Sat Oct 8 20:34:14 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:15.055900 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491e7a0-34b5-4997-a92c-7c2ec346ca80 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:15.066843 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-e328d1dd-ee43-4485-932f-b27a44478afa None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:15.068267 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-e328d1dd-ee43-4485-932f-b27a44478afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:15.078005 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:15.131696 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:15.150093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 362/730] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:15 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:34:15.175736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491e7a0-34b5-4997-a92c-7c2ec346ca80 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:15.202087 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e172d-ea0b-4997-98f0-43b465a07b4e None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:15.202742 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e172d-ea0b-4997-98f0-43b465a07b4e None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:15.203238 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e172d-ea0b-4997-98f0-43b465a07b4e None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:15.205282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 363/731] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:15.209955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed134a10-163d-4499-8cb2-35b07bfb732c None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:15.210588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed134a10-163d-4499-8cb2-35b07bfb732c None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:15.211110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed134a10-163d-4499-8cb2-35b07bfb732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:15.217631 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586af48-7731-47db-8b3c-68ec8cf357d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:15.218276 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586af48-7731-47db-8b3c-68ec8cf357d0 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:15.218557 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586af48-7731-47db-8b3c-68ec8cf357d0 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:15.218828 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586af48-7731-47db-8b3c-68ec8cf357d0 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:15.219564 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586af48-7731-47db-8b3c-68ec8cf357d0 None admin] RBAC: Adding query filter params (name=image) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:15.219872 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586af48-7731-47db-8b3c-68ec8cf357d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:15.221801 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586af48-7731-47db-8b3c-68ec8cf357d0 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:15.226790 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 369/732] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:15.234315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-ed134a10-163d-4499-8cb2-35b07bfb732c None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:15.234852 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586af48-7731-47db-8b3c-68ec8cf357d0 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:15.236200 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-ed134a10-163d-4499-8cb2-35b07bfb732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:15.321403 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 364/733] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:15 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:15.329567 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:15.350367 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586af48-7731-47db-8b3c-68ec8cf357d0 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:15.386106 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df548a59-e1da-4154-b10d-2e41044e18ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:15.387012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df548a59-e1da-4154-b10d-2e41044e18ab None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:15.387432 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df548a59-e1da-4154-b10d-2e41044e18ab None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:15.387867 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df548a59-e1da-4154-b10d-2e41044e18ab None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:15.388636 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df548a59-e1da-4154-b10d-2e41044e18ab None admin] RBAC: Adding query filter params (type=image) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:15.389080 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df548a59-e1da-4154-b10d-2e41044e18ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:15.390588 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df548a59-e1da-4154-b10d-2e41044e18ab None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:15.396110 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 370/734] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:15.405975 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed134a10-163d-4499-8cb2-35b07bfb732c None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:15.503840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df548a59-e1da-4154-b10d-2e41044e18ab None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:15.507826 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed134a10-163d-4499-8cb2-35b07bfb732c None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:15.532956 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:15.545498 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92211d99-0dff-4eb3-9e9f-9a1286dc6f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:15.546158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92211d99-0dff-4eb3-9e9f-9a1286dc6f3f None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:15.546454 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92211d99-0dff-4eb3-9e9f-9a1286dc6f3f None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:15.546812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92211d99-0dff-4eb3-9e9f-9a1286dc6f3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:15.547931 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92211d99-0dff-4eb3-9e9f-9a1286dc6f3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:15.549509 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92211d99-0dff-4eb3-9e9f-9a1286dc6f3f None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:15.575077 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 365/735] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Oct 8 20:34:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:15.633083 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df548a59-e1da-4154-b10d-2e41044e18ab None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:15.655118 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92211d99-0dff-4eb3-9e9f-9a1286dc6f3f None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:15.682027 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d32db9-0859-490c-9e87-471d2485dd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:15.682898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d32db9-0859-490c-9e87-471d2485dd08 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:15.683245 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d32db9-0859-490c-9e87-471d2485dd08 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:15.683583 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d32db9-0859-490c-9e87-471d2485dd08 None admin] PATH_INFO: `/v3/services/network` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:15.684223 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d32db9-0859-490c-9e87-471d2485dd08 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:15.685725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d32db9-0859-490c-9e87-471d2485dd08 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-f0d32db9-0859-490c-9e87-471d2485dd08 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:15.695761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:15.696847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:15.697715 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:15.697715 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:15.697715 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:15.697715 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:15.697715 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:15.697715 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:15.697715 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:15.697715 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:15.697715 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:15.697715 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:15.697715 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:15.697715 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:15.697715 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 08 20:34:15.697715 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:15.702205 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 371/736] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:15 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:15.703661 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d32db9-0859-490c-9e87-471d2485dd08 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:15.713923 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:15.785066 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92211d99-0dff-4eb3-9e9f-9a1286dc6f3f None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:15.818259 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d32db9-0859-490c-9e87-471d2485dd08 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:15.824391 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba27d6b-4af3-41ae-9a5d-0dac286ed2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:15.825034 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba27d6b-4af3-41ae-9a5d-0dac286ed2f1 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:15.825319 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba27d6b-4af3-41ae-9a5d-0dac286ed2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:15.825593 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba27d6b-4af3-41ae-9a5d-0dac286ed2f1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:15.826215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba27d6b-4af3-41ae-9a5d-0dac286ed2f1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:15.827605 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba27d6b-4af3-41ae-9a5d-0dac286ed2f1 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-cba27d6b-4af3-41ae-9a5d-0dac286ed2f1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:15.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:15.840352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:15.841257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:15.841257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:15.841257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:15.841257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:15.841257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:15.841257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:15.841257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:15.841257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:15.841257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:15.841257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:15.841257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:15.841257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:15.841257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 08 20:34:15.841257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:15.842071 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 366/737] 10.222.0.36 () {56 vars in 1129 bytes} [Sat Oct 8 20:34:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:34:15.848151 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba27d6b-4af3-41ae-9a5d-0dac286ed2f1 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:15.855612 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecce9a-b99c-4516-9ca3-2741a458408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:15.856221 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecce9a-b99c-4516-9ca3-2741a458408c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:15.856496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecce9a-b99c-4516-9ca3-2741a458408c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:15.856766 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecce9a-b99c-4516-9ca3-2741a458408c None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:15.857395 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecce9a-b99c-4516-9ca3-2741a458408c None admin] RBAC: Adding query filter params (name=network) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:15.857693 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecce9a-b99c-4516-9ca3-2741a458408c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:15.859619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecce9a-b99c-4516-9ca3-2741a458408c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:15.865970 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 372/738] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Oct 8 20:34:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:15.871240 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecce9a-b99c-4516-9ca3-2741a458408c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:15.906009 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:15.960625 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:15.989681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba27d6b-4af3-41ae-9a5d-0dac286ed2f1 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:16.002695 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecce9a-b99c-4516-9ca3-2741a458408c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:16.034192 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b327aca-bb53-461d-9e25-0deaa08639fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:16.035408 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b327aca-bb53-461d-9e25-0deaa08639fd None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:16.035801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b327aca-bb53-461d-9e25-0deaa08639fd None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:16.036082 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b327aca-bb53-461d-9e25-0deaa08639fd None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:16.036956 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b327aca-bb53-461d-9e25-0deaa08639fd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:16.037265 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b327aca-bb53-461d-9e25-0deaa08639fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:16.039354 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b327aca-bb53-461d-9e25-0deaa08639fd None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:16.045677 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 367/739] 10.222.0.36 () {56 vars in 1124 bytes} [Sat Oct 8 20:34:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:16.050648 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ceb784-5eee-4f22-b163-3b8695a11e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:16.050873 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b327aca-bb53-461d-9e25-0deaa08639fd None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:16.051492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceb784-5eee-4f22-b163-3b8695a11e5f None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:16.051840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceb784-5eee-4f22-b163-3b8695a11e5f None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:16.052190 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ceb784-5eee-4f22-b163-3b8695a11e5f None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:16.052891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ceb784-5eee-4f22-b163-3b8695a11e5f None admin] RBAC: Adding query filter params (type=network) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:16.053260 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ceb784-5eee-4f22-b163-3b8695a11e5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:16.055062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ceb784-5eee-4f22-b163-3b8695a11e5f None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:16.061800 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 373/740] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Oct 8 20:34:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:16.068099 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ceb784-5eee-4f22-b163-3b8695a11e5f None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:16.163565 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b327aca-bb53-461d-9e25-0deaa08639fd None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:16.170871 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:16.173691 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ceb784-5eee-4f22-b163-3b8695a11e5f None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:16.203311 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5d1a9-8b51-490a-9eb6-ac461f7362c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:16.204299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5d1a9-8b51-490a-9eb6-ac461f7362c5 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:16.205441 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5d1a9-8b51-490a-9eb6-ac461f7362c5 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:16.205874 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5d1a9-8b51-490a-9eb6-ac461f7362c5 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:16.206677 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5d1a9-8b51-490a-9eb6-ac461f7362c5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:16.207221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5d1a9-8b51-490a-9eb6-ac461f7362c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:16.208888 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5d1a9-8b51-490a-9eb6-ac461f7362c5 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:16.210028 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57a27b-b779-4a63-9f65-dfba66513832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:16.210685 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57a27b-b779-4a63-9f65-dfba66513832 None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:16.210907 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57a27b-b779-4a63-9f65-dfba66513832 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:16.211178 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57a27b-b779-4a63-9f65-dfba66513832 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:16.212085 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57a27b-b779-4a63-9f65-dfba66513832 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:16.213159 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57a27b-b779-4a63-9f65-dfba66513832 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:16.219914 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 368/741] 10.222.0.36 () {56 vars in 1124 bytes} [Sat Oct 8 20:34:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:16.221481 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5d1a9-8b51-490a-9eb6-ac461f7362c5 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:16.223346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:16.250275 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 374/742] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Oct 8 20:34:16 2022] POST /identity/v3/endpoints => generated 337 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:34:16.336472 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5d1a9-8b51-490a-9eb6-ac461f7362c5 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:16.382412 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef02aff-ab19-442b-99f7-55aad7c5bcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:16.383341 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef02aff-ab19-442b-99f7-55aad7c5bcce None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:16.383800 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef02aff-ab19-442b-99f7-55aad7c5bcce None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:16.384265 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef02aff-ab19-442b-99f7-55aad7c5bcce None admin] PATH_INFO: `/v3/endpoints` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:16.385122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef02aff-ab19-442b-99f7-55aad7c5bcce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:16.386708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef02aff-ab19-442b-99f7-55aad7c5bcce None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:16.411725 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 369/743] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Oct 8 20:34:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:34:17.152671 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa822fb2-210b-45ae-9091-686a9e3a2b88 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:17.153215 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa822fb2-210b-45ae-9091-686a9e3a2b88 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:17.153215 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa822fb2-210b-45ae-9091-686a9e3a2b88 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:17.154736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 375/744] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:17.160155 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dc770-efd0-4fa6-9689-ff0d5364a7ef None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:17.160613 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dc770-efd0-4fa6-9689-ff0d5364a7ef None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:17.160706 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dc770-efd0-4fa6-9689-ff0d5364a7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:17.181827 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-4c9dc770-efd0-4fa6-9689-ff0d5364a7ef None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:17.183066 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-4c9dc770-efd0-4fa6-9689-ff0d5364a7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:17.201375 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:17.265118 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 370/745] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:17 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:17.601624 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa822fb2-210b-45ae-9091-686a9e3a2b88 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:17.723797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa822fb2-210b-45ae-9091-686a9e3a2b88 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:17.761542 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd3797-71d8-40fc-ab32-a88bb750f6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:17.762205 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3797-71d8-40fc-ab32-a88bb750f6b9 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:17.762486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3797-71d8-40fc-ab32-a88bb750f6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:17.762758 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3797-71d8-40fc-ab32-a88bb750f6b9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:17.763341 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd3797-71d8-40fc-ab32-a88bb750f6b9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:17.764720 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd3797-71d8-40fc-ab32-a88bb750f6b9 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-1edd3797-71d8-40fc-ab32-a88bb750f6b9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:17.773916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:17.774859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:17.775769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:17.775769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:17.775769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:17.775769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:17.775769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:17.775769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:17.775769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:17.775769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:17.775769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:17.775769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:17.775769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:17.775769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:17.775769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:34:17.775769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:17.778236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 376/746] 10.222.0.36 () {56 vars in 1132 bytes} [Sat Oct 8 20:34:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:17.780770 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dc770-efd0-4fa6-9689-ff0d5364a7ef None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:17.881343 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dc770-efd0-4fa6-9689-ff0d5364a7ef None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:17.915964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e965740-09fb-4d97-93cb-a921fbf5e917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:17.916577 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e965740-09fb-4d97-93cb-a921fbf5e917 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:17.916856 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e965740-09fb-4d97-93cb-a921fbf5e917 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:17.917128 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e965740-09fb-4d97-93cb-a921fbf5e917 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:17.917752 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e965740-09fb-4d97-93cb-a921fbf5e917 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:17.918082 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e965740-09fb-4d97-93cb-a921fbf5e917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:17.919436 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e965740-09fb-4d97-93cb-a921fbf5e917 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:17.928723 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 371/747] 10.222.0.36 () {56 vars in 1126 bytes} [Sat Oct 8 20:34:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:17.930337 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd3797-71d8-40fc-ab32-a88bb750f6b9 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:17.988811 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:18.035498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd3797-71d8-40fc-ab32-a88bb750f6b9 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:18.076755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc19467-dc6f-41ea-9278-d1e7ac2c5d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:18.077361 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc19467-dc6f-41ea-9278-d1e7ac2c5d25 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:18.077640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc19467-dc6f-41ea-9278-d1e7ac2c5d25 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:18.077934 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc19467-dc6f-41ea-9278-d1e7ac2c5d25 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:18.078559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc19467-dc6f-41ea-9278-d1e7ac2c5d25 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:18.078859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc19467-dc6f-41ea-9278-d1e7ac2c5d25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:18.080717 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc19467-dc6f-41ea-9278-d1e7ac2c5d25 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:18.094301 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 377/748] 10.222.0.36 () {56 vars in 1126 bytes} [Sat Oct 8 20:34:17 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:18.169481 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88463121-92c7-4f2d-bb19-233a98435fe2 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:18.170045 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88463121-92c7-4f2d-bb19-233a98435fe2 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:18.170045 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88463121-92c7-4f2d-bb19-233a98435fe2 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:18.171523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 372/749] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:18.177231 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddb904-ecb6-441a-9b3f-28d1deac01bb None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:18.177773 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddb904-ecb6-441a-9b3f-28d1deac01bb None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:18.177773 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddb904-ecb6-441a-9b3f-28d1deac01bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:18.197711 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-e5ddb904-ecb6-441a-9b3f-28d1deac01bb None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:18.199002 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-e5ddb904-ecb6-441a-9b3f-28d1deac01bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:18.277934 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 378/750] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:18 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:18.594442 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88463121-92c7-4f2d-bb19-233a98435fe2 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:18.609607 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:18.702557 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88463121-92c7-4f2d-bb19-233a98435fe2 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:18.737537 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee203b5-5d5a-4c06-8172-6b8f1ad9f909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:18.738172 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee203b5-5d5a-4c06-8172-6b8f1ad9f909 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:18.738458 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee203b5-5d5a-4c06-8172-6b8f1ad9f909 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:18.738743 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee203b5-5d5a-4c06-8172-6b8f1ad9f909 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:18.805364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee203b5-5d5a-4c06-8172-6b8f1ad9f909 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:18.806838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee203b5-5d5a-4c06-8172-6b8f1ad9f909 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:18.822165 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:18.908573 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 373/751] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:34:18 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:34:18.915108 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddb904-ecb6-441a-9b3f-28d1deac01bb None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:18.965474 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:18.994477 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a73e01-007d-4da3-aec0-1138e3f4e369 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:18.994768 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a73e01-007d-4da3-aec0-1138e3f4e369 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:18.995049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a73e01-007d-4da3-aec0-1138e3f4e369 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:18.996642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 374/752] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:34:19.001984 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e110e-70dd-41a5-9593-4ed4a893b759 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:19.002419 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e110e-70dd-41a5-9593-4ed4a893b759 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:19.002694 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e110e-70dd-41a5-9593-4ed4a893b759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:19.020299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-f99e110e-70dd-41a5-9593-4ed4a893b759 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:19.021191 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddb904-ecb6-441a-9b3f-28d1deac01bb None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:19.021477 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-f99e110e-70dd-41a5-9593-4ed4a893b759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:19.064930 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5d23a-40aa-4684-b4d3-e01b61dd93e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:19.065650 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d23a-40aa-4684-b4d3-e01b61dd93e6 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:19.065961 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d23a-40aa-4684-b4d3-e01b61dd93e6 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:19.066242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d23a-40aa-4684-b4d3-e01b61dd93e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:19.077686 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5d23a-40aa-4684-b4d3-e01b61dd93e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:19.079151 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5d23a-40aa-4684-b4d3-e01b61dd93e6 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:19.094502 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 375/753] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:19 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-42a5d23a-40aa-4684-b4d3-e01b61dd93e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:34:19.094741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:19.096010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:34:19.097240 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:34:19.097240 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:34:19.097240 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:19.100829 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 379/754] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:34:19.102893 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e110e-70dd-41a5-9593-4ed4a893b759 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:19.146170 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:19.206500 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e110e-70dd-41a5-9593-4ed4a893b759 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:19.239764 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb924d05-5451-4585-81dc-a4d04442b8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:19.240369 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb924d05-5451-4585-81dc-a4d04442b8d9 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:19.240646 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb924d05-5451-4585-81dc-a4d04442b8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:19.240917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb924d05-5451-4585-81dc-a4d04442b8d9 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:19.241544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb924d05-5451-4585-81dc-a4d04442b8d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:19.241857 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb924d05-5451-4585-81dc-a4d04442b8d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:19.243212 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb924d05-5451-4585-81dc-a4d04442b8d9 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:19.261910 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 376/755] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:19.419730 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5d23a-40aa-4684-b4d3-e01b61dd93e6 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:19.521805 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:19.524966 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5d23a-40aa-4684-b4d3-e01b61dd93e6 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:19.560934 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cd450-94fe-4698-bd0f-5c6a4c2978d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:19.561567 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cd450-94fe-4698-bd0f-5c6a4c2978d7 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:19.561866 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cd450-94fe-4698-bd0f-5c6a4c2978d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:19.562251 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cd450-94fe-4698-bd0f-5c6a4c2978d7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:19.562872 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cd450-94fe-4698-bd0f-5c6a4c2978d7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:19.564658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cd450-94fe-4698-bd0f-5c6a4c2978d7 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-1a3cd450-94fe-4698-bd0f-5c6a4c2978d7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:19.573122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:19.574120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:19.575360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:19.575360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:19.575360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:19.575360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:19.575360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:19.575360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:19.575360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:19.575360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:19.575360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:19.575360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:19.575360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:19.575360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:19.575360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:34:19.575360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:19.575360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 380/756] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:34:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:19.580861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb924d05-5451-4585-81dc-a4d04442b8d9 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:19.690116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb924d05-5451-4585-81dc-a4d04442b8d9 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:19.691587 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:19.723225 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc6bb5-1335-4a67-acdf-edf52c9ddef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:19.723826 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc6bb5-1335-4a67-acdf-edf52c9ddef4 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:19.724111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc6bb5-1335-4a67-acdf-edf52c9ddef4 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:19.724386 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc6bb5-1335-4a67-acdf-edf52c9ddef4 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:19.725007 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc6bb5-1335-4a67-acdf-edf52c9ddef4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:19.725313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc6bb5-1335-4a67-acdf-edf52c9ddef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:19.726692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc6bb5-1335-4a67-acdf-edf52c9ddef4 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:19.731054 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 377/757] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:34:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:19.737189 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cd450-94fe-4698-bd0f-5c6a4c2978d7 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:19.834063 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cd450-94fe-4698-bd0f-5c6a4c2978d7 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:19.868131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d0e2f-1838-4cad-b032-4c612472b52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:19.868730 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0e2f-1838-4cad-b032-4c612472b52a None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:19.869008 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0e2f-1838-4cad-b032-4c612472b52a None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:19.869280 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0e2f-1838-4cad-b032-4c612472b52a None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:19.869927 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d0e2f-1838-4cad-b032-4c612472b52a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:19.870232 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d0e2f-1838-4cad-b032-4c612472b52a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:19.871582 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d0e2f-1838-4cad-b032-4c612472b52a None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:19.875987 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 381/758] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:34:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:20.517945 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8745a-4b60-43c7-bc7a-66a78548e783 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:20.518510 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8745a-4b60-43c7-bc7a-66a78548e783 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:20.518510 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8745a-4b60-43c7-bc7a-66a78548e783 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:20.519799 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 378/759] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:20.525201 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58f0e5-eaa6-44c6-82b5-c617f2d5ff51 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:20.525620 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58f0e5-eaa6-44c6-82b5-c617f2d5ff51 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:20.525749 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58f0e5-eaa6-44c6-82b5-c617f2d5ff51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:20.666642 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-ea58f0e5-eaa6-44c6-82b5-c617f2d5ff51 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:20.667840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-ea58f0e5-eaa6-44c6-82b5-c617f2d5ff51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:20.691531 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:20.735778 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 382/760] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:20 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:21.059354 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8745a-4b60-43c7-bc7a-66a78548e783 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:21.157044 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8745a-4b60-43c7-bc7a-66a78548e783 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:21.191172 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4f368-eff2-46ad-a128-0064bbf84f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:21.191771 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4f368-eff2-46ad-a128-0064bbf84f20 None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:21.192047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4f368-eff2-46ad-a128-0064bbf84f20 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:21.192317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4f368-eff2-46ad-a128-0064bbf84f20 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:21.192951 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4f368-eff2-46ad-a128-0064bbf84f20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:21.194385 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4f368-eff2-46ad-a128-0064bbf84f20 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:21.208821 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 379/761] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Oct 8 20:34:21 2022] POST /identity/v3/services => generated 269 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:22.265781 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1265ae1-30f7-4482-94fd-7779d1e0a1b9 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:22.266392 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1265ae1-30f7-4482-94fd-7779d1e0a1b9 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:22.266392 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1265ae1-30f7-4482-94fd-7779d1e0a1b9 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:22.267756 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 383/762] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:22.273667 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f005-54d5-4c8e-8bdc-00ffb854d276 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:22.274179 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f005-54d5-4c8e-8bdc-00ffb854d276 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:22.274270 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f005-54d5-4c8e-8bdc-00ffb854d276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:22.292687 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-84e3f005-54d5-4c8e-8bdc-00ffb854d276 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:22.293869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-84e3f005-54d5-4c8e-8bdc-00ffb854d276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:22.313868 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:22.367103 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 380/763] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:22 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:22.696220 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1265ae1-30f7-4482-94fd-7779d1e0a1b9 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:22.793769 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1265ae1-30f7-4482-94fd-7779d1e0a1b9 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:22.826741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c19475-8cad-43e1-b9d9-6a7a1bbc48e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:22.827338 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c19475-8cad-43e1-b9d9-6a7a1bbc48e0 None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:22.827617 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c19475-8cad-43e1-b9d9-6a7a1bbc48e0 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:22.827892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c19475-8cad-43e1-b9d9-6a7a1bbc48e0 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:22.828594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c19475-8cad-43e1-b9d9-6a7a1bbc48e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:22.830544 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c19475-8cad-43e1-b9d9-6a7a1bbc48e0 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:22.847111 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 384/764] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Oct 8 20:34:22 2022] POST /identity/v3/services => generated 251 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:23.593513 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf08a5e-6371-42b2-a2d8-37112a4a4399 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:23.594067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf08a5e-6371-42b2-a2d8-37112a4a4399 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:23.594178 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf08a5e-6371-42b2-a2d8-37112a4a4399 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:23.595944 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 381/765] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:23.601294 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cee7a0-e4e6-4deb-8b96-891c551ce680 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:23.601707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cee7a0-e4e6-4deb-8b96-891c551ce680 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:23.601931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cee7a0-e4e6-4deb-8b96-891c551ce680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:23.620558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-e9cee7a0-e4e6-4deb-8b96-891c551ce680 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:23.621838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-e9cee7a0-e4e6-4deb-8b96-891c551ce680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:23.635566 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:23.693934 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 385/766] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:23 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:24.014627 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf08a5e-6371-42b2-a2d8-37112a4a4399 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:24.115934 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf08a5e-6371-42b2-a2d8-37112a4a4399 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:24.149237 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907de07-05b0-4707-93d6-89943b1eda80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:24.149868 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907de07-05b0-4707-93d6-89943b1eda80 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:24.150179 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907de07-05b0-4707-93d6-89943b1eda80 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:24.150455 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907de07-05b0-4707-93d6-89943b1eda80 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:24.151031 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907de07-05b0-4707-93d6-89943b1eda80 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:24.152378 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907de07-05b0-4707-93d6-89943b1eda80 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-7907de07-05b0-4707-93d6-89943b1eda80 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:24.161433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:24.162578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:24.163678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:24.163678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:24.163678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:24.163678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:24.163678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:24.163678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:24.163678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:24.163678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:24.163678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:24.163678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:24.163678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:24.163678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:24.163678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:34:24.163678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:24.164803 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 382/767] 10.222.0.36 () {56 vars in 1132 bytes} [Sat Oct 8 20:34:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:24.168519 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cee7a0-e4e6-4deb-8b96-891c551ce680 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:24.266323 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cee7a0-e4e6-4deb-8b96-891c551ce680 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:24.299529 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11ea09-cd7c-48fa-ac79-19be8654bb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:24.300125 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11ea09-cd7c-48fa-ac79-19be8654bb6b None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:24.300401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11ea09-cd7c-48fa-ac79-19be8654bb6b None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:24.300671 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11ea09-cd7c-48fa-ac79-19be8654bb6b None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:24.301285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11ea09-cd7c-48fa-ac79-19be8654bb6b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:24.301582 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11ea09-cd7c-48fa-ac79-19be8654bb6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:24.302962 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11ea09-cd7c-48fa-ac79-19be8654bb6b None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:24.307498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 386/768] 10.222.0.36 () {56 vars in 1126 bytes} [Sat Oct 8 20:34:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:24.313125 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907de07-05b0-4707-93d6-89943b1eda80 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:24.331023 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:24.411870 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907de07-05b0-4707-93d6-89943b1eda80 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:24.444103 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c439e8-1609-42d1-aff4-e8dde6ab9bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:24.444700 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c439e8-1609-42d1-aff4-e8dde6ab9bc2 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:24.444978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c439e8-1609-42d1-aff4-e8dde6ab9bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:24.445246 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c439e8-1609-42d1-aff4-e8dde6ab9bc2 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:24.445860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c439e8-1609-42d1-aff4-e8dde6ab9bc2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:24.446187 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c439e8-1609-42d1-aff4-e8dde6ab9bc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:24.447526 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c439e8-1609-42d1-aff4-e8dde6ab9bc2 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:24.452055 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 383/769] 10.222.0.36 () {56 vars in 1126 bytes} [Sat Oct 8 20:34:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:24.458583 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11ea09-cd7c-48fa-ac79-19be8654bb6b None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:24.469258 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:24.556135 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11ea09-cd7c-48fa-ac79-19be8654bb6b None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:24.589355 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9f528-e6ef-4a6b-8927-932cbb41a462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:24.589982 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9f528-e6ef-4a6b-8927-932cbb41a462 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:24.590265 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9f528-e6ef-4a6b-8927-932cbb41a462 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:24.590539 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9f528-e6ef-4a6b-8927-932cbb41a462 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:24.591227 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9f528-e6ef-4a6b-8927-932cbb41a462 None admin] RBAC: Adding query filter params (interface=public, service_id=3ce80ae387044436a2af1bbf8a49cdb0, region_id=RegionOne) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:24.591534 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9f528-e6ef-4a6b-8927-932cbb41a462 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:24.592877 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9f528-e6ef-4a6b-8927-932cbb41a462 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:24.597731 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 387/770] 10.222.0.36 () {56 vars in 1251 bytes} [Sat Oct 8 20:34:24 2022] GET /identity/v3/endpoints?service_id=3ce80ae387044436a2af1bbf8a49cdb0&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:24.603484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c439e8-1609-42d1-aff4-e8dde6ab9bc2 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:24.682869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:24.702018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c439e8-1609-42d1-aff4-e8dde6ab9bc2 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:24.733643 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eddc52-a9e7-4115-bc9f-76e3a62526ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:24.734277 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eddc52-a9e7-4115-bc9f-76e3a62526ae None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:24.734558 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eddc52-a9e7-4115-bc9f-76e3a62526ae None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:24.734828 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eddc52-a9e7-4115-bc9f-76e3a62526ae None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:24.735419 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eddc52-a9e7-4115-bc9f-76e3a62526ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:24.737334 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eddc52-a9e7-4115-bc9f-76e3a62526ae None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:24.743062 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 384/771] 10.222.0.36 () {56 vars in 1087 bytes} [Sat Oct 8 20:34:24 2022] GET /identity/v3/services => generated 1498 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:34:25.304447 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a1e9d-84fb-4c8b-bd65-9d38de3ecb91 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:25.304733 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a1e9d-84fb-4c8b-bd65-9d38de3ecb91 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:25.305011 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a1e9d-84fb-4c8b-bd65-9d38de3ecb91 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:25.306378 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 388/772] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:25.311557 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f2894-0250-40cd-a095-28754516dce7 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:25.311790 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f2894-0250-40cd-a095-28754516dce7 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:25.312069 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f2894-0250-40cd-a095-28754516dce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:25.331063 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-3d3f2894-0250-40cd-a095-28754516dce7 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:25.332227 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-3d3f2894-0250-40cd-a095-28754516dce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:25.395987 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 385/773] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:25 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:25.718072 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a1e9d-84fb-4c8b-bd65-9d38de3ecb91 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:25.788153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:25.820287 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a1e9d-84fb-4c8b-bd65-9d38de3ecb91 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:25.853698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c744877-a12f-4c81-a065-f82feeb262bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:25.854349 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c744877-a12f-4c81-a065-f82feeb262bc None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:25.854630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c744877-a12f-4c81-a065-f82feeb262bc None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:25.854903 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c744877-a12f-4c81-a065-f82feeb262bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:25.855476 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c744877-a12f-4c81-a065-f82feeb262bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:25.856820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c744877-a12f-4c81-a065-f82feeb262bc None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-3c744877-a12f-4c81-a065-f82feeb262bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:25.866309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:25.867454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:25.868336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:25.868336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:25.868336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:25.868336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:25.868336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:25.868336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:25.868336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:25.868336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:25.868336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:25.868336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:25.868336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:25.868336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:25.868336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:34:25.868336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:25.868336 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 389/774] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:34:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:25.873272 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f2894-0250-40cd-a095-28754516dce7 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:25.945933 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:25.972386 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f2894-0250-40cd-a095-28754516dce7 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:26.005273 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c4f9d-3ccb-4c30-9802-f031e7b65839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:26.005865 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c4f9d-3ccb-4c30-9802-f031e7b65839 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:26.006164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c4f9d-3ccb-4c30-9802-f031e7b65839 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:26.006431 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c4f9d-3ccb-4c30-9802-f031e7b65839 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:26.007046 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c4f9d-3ccb-4c30-9802-f031e7b65839 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:26.007346 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c4f9d-3ccb-4c30-9802-f031e7b65839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:26.008692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c4f9d-3ccb-4c30-9802-f031e7b65839 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:26.013151 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 386/775] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:34:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:26.019704 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c744877-a12f-4c81-a065-f82feeb262bc None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:26.118608 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c744877-a12f-4c81-a065-f82feeb262bc None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:26.151614 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f787228-34d8-4588-9019-0feb4c974958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:26.152217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f787228-34d8-4588-9019-0feb4c974958 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:26.152498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f787228-34d8-4588-9019-0feb4c974958 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:26.152772 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f787228-34d8-4588-9019-0feb4c974958 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:26.153400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f787228-34d8-4588-9019-0feb4c974958 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:26.153702 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f787228-34d8-4588-9019-0feb4c974958 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:26.155097 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f787228-34d8-4588-9019-0feb4c974958 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:26.157043 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:26.162241 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 390/776] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:34:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:26.166323 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c4f9d-3ccb-4c30-9802-f031e7b65839 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:26.261877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c4f9d-3ccb-4c30-9802-f031e7b65839 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:26.294552 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033059b-64fb-460e-b7d9-c51a63b2b6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:26.295152 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033059b-64fb-460e-b7d9-c51a63b2b6ef None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:26.295433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033059b-64fb-460e-b7d9-c51a63b2b6ef None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:26.295708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033059b-64fb-460e-b7d9-c51a63b2b6ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:26.296399 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033059b-64fb-460e-b7d9-c51a63b2b6ef None admin] RBAC: Adding query filter params (interface=public, service_id=76e07bf0f9fc4192a0dbbd1053415fc5, region_id=RegionOne) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:26.296709 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033059b-64fb-460e-b7d9-c51a63b2b6ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:26.298126 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033059b-64fb-460e-b7d9-c51a63b2b6ef None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:26.303125 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 387/777] 10.222.0.36 () {56 vars in 1251 bytes} [Sat Oct 8 20:34:26 2022] GET /identity/v3/endpoints?service_id=76e07bf0f9fc4192a0dbbd1053415fc5&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:26.308787 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f787228-34d8-4588-9019-0feb4c974958 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:26.408882 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f787228-34d8-4588-9019-0feb4c974958 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:26.443824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298da94-8c23-4e3d-972f-49af0d2dfb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:26.444427 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298da94-8c23-4e3d-972f-49af0d2dfb67 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:26.444704 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298da94-8c23-4e3d-972f-49af0d2dfb67 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:26.444975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298da94-8c23-4e3d-972f-49af0d2dfb67 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:26.445571 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298da94-8c23-4e3d-972f-49af0d2dfb67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:26.446954 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298da94-8c23-4e3d-972f-49af0d2dfb67 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:26.452745 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 391/778] 10.222.0.36 () {56 vars in 1087 bytes} [Sat Oct 8 20:34:26 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:34:27.134093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4f1a2-fb12-4be3-9adc-f806ff5e64c6 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.134609 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4f1a2-fb12-4be3-9adc-f806ff5e64c6 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.134698 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4f1a2-fb12-4be3-9adc-f806ff5e64c6 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.135954 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 388/779] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:27.141243 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabb70c-d27c-4c09-8305-d8a0404a247a None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.141654 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabb70c-d27c-4c09-8305-d8a0404a247a None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.142351 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabb70c-d27c-4c09-8305-d8a0404a247a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.160542 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-4eabb70c-d27c-4c09-8305-d8a0404a247a None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:27.161704 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-4eabb70c-d27c-4c09-8305-d8a0404a247a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:27.218872 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:27.227994 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 392/780] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:27 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:27.558085 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4f1a2-fb12-4be3-9adc-f806ff5e64c6 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:27.560958 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:27.659893 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4f1a2-fb12-4be3-9adc-f806ff5e64c6 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:27.694241 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d99dc-fffb-4d2e-b2a6-b8b71b945556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:27.694872 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d99dc-fffb-4d2e-b2a6-b8b71b945556 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.695150 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d99dc-fffb-4d2e-b2a6-b8b71b945556 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.695421 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d99dc-fffb-4d2e-b2a6-b8b71b945556 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.695995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d99dc-fffb-4d2e-b2a6-b8b71b945556 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:27.697347 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d99dc-fffb-4d2e-b2a6-b8b71b945556 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-df5d99dc-fffb-4d2e-b2a6-b8b71b945556 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:27.706083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:27.707093 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:27.708018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:27.708018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:27.708018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:27.708018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:27.708018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:27.708018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:27.708018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:27.708018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:27.708018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:27.708018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:27.708018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:27.708018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:27.708018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 08 20:34:27.708018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:27.708018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 389/781] 10.222.0.36 () {56 vars in 1132 bytes} [Sat Oct 8 20:34:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:27.713119 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabb70c-d27c-4c09-8305-d8a0404a247a None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:27.808982 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabb70c-d27c-4c09-8305-d8a0404a247a None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:27.841731 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54640c-2b45-4612-a083-f78a0ace772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:27.842362 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54640c-2b45-4612-a083-f78a0ace772b None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.842641 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54640c-2b45-4612-a083-f78a0ace772b None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.842913 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54640c-2b45-4612-a083-f78a0ace772b None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.843533 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54640c-2b45-4612-a083-f78a0ace772b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:27.843835 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54640c-2b45-4612-a083-f78a0ace772b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:27.845231 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54640c-2b45-4612-a083-f78a0ace772b None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:27.849836 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 393/782] 10.222.0.36 () {56 vars in 1126 bytes} [Sat Oct 8 20:34:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:27.855665 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d99dc-fffb-4d2e-b2a6-b8b71b945556 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:27.919821 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:27.953787 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d99dc-fffb-4d2e-b2a6-b8b71b945556 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:27.986501 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59564b0b-7ec8-49be-9aa3-5b462b45b9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:27.987081 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59564b0b-7ec8-49be-9aa3-5b462b45b9a9 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:27.987364 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59564b0b-7ec8-49be-9aa3-5b462b45b9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:27.987634 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59564b0b-7ec8-49be-9aa3-5b462b45b9a9 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:27.988249 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59564b0b-7ec8-49be-9aa3-5b462b45b9a9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:27.988551 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59564b0b-7ec8-49be-9aa3-5b462b45b9a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:27.989915 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59564b0b-7ec8-49be-9aa3-5b462b45b9a9 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:27.994459 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 390/783] 10.222.0.36 () {56 vars in 1126 bytes} [Sat Oct 8 20:34:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:28.000229 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54640c-2b45-4612-a083-f78a0ace772b None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:28.060477 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:28.101567 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54640c-2b45-4612-a083-f78a0ace772b None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:28.134476 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b8696-83b4-4d70-8518-fd73b1ba9925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:28.135071 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b8696-83b4-4d70-8518-fd73b1ba9925 None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:28.135349 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b8696-83b4-4d70-8518-fd73b1ba9925 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:28.135620 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b8696-83b4-4d70-8518-fd73b1ba9925 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:28.136292 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b8696-83b4-4d70-8518-fd73b1ba9925 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:28.137631 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b8696-83b4-4d70-8518-fd73b1ba9925 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:28.155957 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 394/784] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Oct 8 20:34:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:28.853738 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33772cc-508f-493b-9be4-ef2578cee144 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:28.854309 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33772cc-508f-493b-9be4-ef2578cee144 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:28.854467 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33772cc-508f-493b-9be4-ef2578cee144 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:28.855790 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 391/785] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:28.861670 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607bbd0-2c5c-4772-bd2a-b4caaae4a42d None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:28.861989 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607bbd0-2c5c-4772-bd2a-b4caaae4a42d None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:28.862264 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607bbd0-2c5c-4772-bd2a-b4caaae4a42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:28.880406 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-a607bbd0-2c5c-4772-bd2a-b4caaae4a42d None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:28.881581 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-a607bbd0-2c5c-4772-bd2a-b4caaae4a42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:28.952512 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 395/786] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:28 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:29.273794 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33772cc-508f-493b-9be4-ef2578cee144 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:29.372978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33772cc-508f-493b-9be4-ef2578cee144 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:29.400634 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:29.406676 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1d759-c7fa-48bb-85bd-7d6e723e9629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:29.407839 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1d759-c7fa-48bb-85bd-7d6e723e9629 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:29.408130 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1d759-c7fa-48bb-85bd-7d6e723e9629 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:29.408409 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1d759-c7fa-48bb-85bd-7d6e723e9629 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:29.408987 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1d759-c7fa-48bb-85bd-7d6e723e9629 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:29.410413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1d759-c7fa-48bb-85bd-7d6e723e9629 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-a3b1d759-c7fa-48bb-85bd-7d6e723e9629 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:29.419110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:29.420278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:29.421134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:29.421134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:29.421134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:29.421134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:29.421134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:29.421134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:29.421134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:29.421134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:29.421134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:29.421134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:29.421134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:29.421134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:29.421134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 08 20:34:29.421134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:29.421134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 392/787] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:34:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:29.426430 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607bbd0-2c5c-4772-bd2a-b4caaae4a42d None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:29.466859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:29.524004 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607bbd0-2c5c-4772-bd2a-b4caaae4a42d None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:29.556394 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8b448-913d-46f3-95ce-e2d17d758bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:29.556994 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8b448-913d-46f3-95ce-e2d17d758bde None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:29.557272 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8b448-913d-46f3-95ce-e2d17d758bde None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:29.557545 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8b448-913d-46f3-95ce-e2d17d758bde None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:29.558196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8b448-913d-46f3-95ce-e2d17d758bde None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:29.558499 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8b448-913d-46f3-95ce-e2d17d758bde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:29.559849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8b448-913d-46f3-95ce-e2d17d758bde None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:29.565007 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 396/788] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:34:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:29.570687 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1d759-c7fa-48bb-85bd-7d6e723e9629 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:29.667701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1d759-c7fa-48bb-85bd-7d6e723e9629 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:29.701499 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a40e29-fdb8-4513-8ed4-3d562650f1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:29.702129 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a40e29-fdb8-4513-8ed4-3d562650f1c5 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:29.702412 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a40e29-fdb8-4513-8ed4-3d562650f1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:29.702680 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a40e29-fdb8-4513-8ed4-3d562650f1c5 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:29.703292 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a40e29-fdb8-4513-8ed4-3d562650f1c5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:29.703591 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a40e29-fdb8-4513-8ed4-3d562650f1c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:29.705603 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a40e29-fdb8-4513-8ed4-3d562650f1c5 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:29.710392 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 393/789] 10.222.0.36 () {56 vars in 1114 bytes} [Sat Oct 8 20:34:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:29.716002 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8b448-913d-46f3-95ce-e2d17d758bde None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:29.811132 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8b448-913d-46f3-95ce-e2d17d758bde None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:29.813303 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:29.844614 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ef20b-c0ce-4919-9df9-2d17e358221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:29.845298 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ef20b-c0ce-4919-9df9-2d17e358221c None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:29.845581 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ef20b-c0ce-4919-9df9-2d17e358221c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:29.845854 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ef20b-c0ce-4919-9df9-2d17e358221c None admin] PATH_INFO: `/v3/endpoints` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:29.846549 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ef20b-c0ce-4919-9df9-2d17e358221c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:29.847899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ef20b-c0ce-4919-9df9-2d17e358221c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:29.868312 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 397/790] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Oct 8 20:34:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:30.578197 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619b7a6-487d-43fa-ae45-eb72f3ffb0bc None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:30.578726 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619b7a6-487d-43fa-ae45-eb72f3ffb0bc None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:30.578726 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619b7a6-487d-43fa-ae45-eb72f3ffb0bc None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:30.580233 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 394/791] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:30.585603 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1291e3-baf3-43cf-aad3-1b7f194df09f None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:30.586040 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1291e3-baf3-43cf-aad3-1b7f194df09f None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:30.586192 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1291e3-baf3-43cf-aad3-1b7f194df09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:30.604187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-3a1291e3-baf3-43cf-aad3-1b7f194df09f None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:30.605355 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-3a1291e3-baf3-43cf-aad3-1b7f194df09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:30.676308 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 398/792] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:30 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:31.004485 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619b7a6-487d-43fa-ae45-eb72f3ffb0bc None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:31.064708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:31.106663 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619b7a6-487d-43fa-ae45-eb72f3ffb0bc None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:31.139365 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27946857-688a-4c4d-9037-23d9f0085509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:31.139992 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27946857-688a-4c4d-9037-23d9f0085509 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:31.140277 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27946857-688a-4c4d-9037-23d9f0085509 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:31.140553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27946857-688a-4c4d-9037-23d9f0085509 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:31.141127 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27946857-688a-4c4d-9037-23d9f0085509 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:31.143382 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27946857-688a-4c4d-9037-23d9f0085509 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-27946857-688a-4c4d-9037-23d9f0085509 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:31.151991 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:31.152993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:31.153834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:31.153834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:31.153834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:31.153834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:31.153834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:31.153834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:31.153834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:31.153834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:31.153834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:31.153834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:31.153834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:31.153834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:31.153834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:34:31.153834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:31.153834 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 395/793] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:31.158997 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1291e3-baf3-43cf-aad3-1b7f194df09f None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:31.243219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:31.259812 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1291e3-baf3-43cf-aad3-1b7f194df09f None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:31.292325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69207df7-1e01-4a32-9f46-17832ebe3daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:31.292916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69207df7-1e01-4a32-9f46-17832ebe3daa None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:31.293192 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69207df7-1e01-4a32-9f46-17832ebe3daa None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:31.293459 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69207df7-1e01-4a32-9f46-17832ebe3daa None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:31.294111 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69207df7-1e01-4a32-9f46-17832ebe3daa None admin] RBAC: Adding query filter params (name=compute) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:31.294411 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69207df7-1e01-4a32-9f46-17832ebe3daa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:31.295747 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69207df7-1e01-4a32-9f46-17832ebe3daa None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:31.300275 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 399/794] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Oct 8 20:34:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:31.306072 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27946857-688a-4c4d-9037-23d9f0085509 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:31.403194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27946857-688a-4c4d-9037-23d9f0085509 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:31.424678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:31.436123 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd0e42-d73d-4d06-a43a-513a5e1fc0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:31.436721 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd0e42-d73d-4d06-a43a-513a5e1fc0c9 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:31.437002 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd0e42-d73d-4d06-a43a-513a5e1fc0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:31.437277 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd0e42-d73d-4d06-a43a-513a5e1fc0c9 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:31.437921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd0e42-d73d-4d06-a43a-513a5e1fc0c9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:31.438228 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd0e42-d73d-4d06-a43a-513a5e1fc0c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:31.440325 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd0e42-d73d-4d06-a43a-513a5e1fc0c9 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:31.444561 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 396/795] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Oct 8 20:34:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:32.275595 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813691d-607d-4b3a-9f16-12c96cb2ff4d None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:32.276173 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813691d-607d-4b3a-9f16-12c96cb2ff4d None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:32.276283 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813691d-607d-4b3a-9f16-12c96cb2ff4d None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:32.277547 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 400/796] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:32.283048 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5475c69-4144-462b-91ae-3129eda9da26 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:32.283451 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5475c69-4144-462b-91ae-3129eda9da26 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:32.283750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5475c69-4144-462b-91ae-3129eda9da26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:32.302267 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-e5475c69-4144-462b-91ae-3129eda9da26 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:32.303444 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-e5475c69-4144-462b-91ae-3129eda9da26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:32.367200 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 397/797] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:32 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:32.690708 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813691d-607d-4b3a-9f16-12c96cb2ff4d None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:32.789813 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813691d-607d-4b3a-9f16-12c96cb2ff4d None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:32.822251 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85277660-fde2-4001-92ec-00eb06eeb4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:32.822847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85277660-fde2-4001-92ec-00eb06eeb4e1 None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:32.823125 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85277660-fde2-4001-92ec-00eb06eeb4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:32.823395 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85277660-fde2-4001-92ec-00eb06eeb4e1 None admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:32.824034 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85277660-fde2-4001-92ec-00eb06eeb4e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:32.825438 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85277660-fde2-4001-92ec-00eb06eeb4e1 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:32.828034 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: WARNING keystone.server.flask.common [None req-85277660-fde2-4001-92ec-00eb06eeb4e1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 08 20:34:32.845154 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.sql.core [None req-85277660-fde2-4001-92ec-00eb06eeb4e1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 08 20:34:32.845154 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 08 20:34:32.845154 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [parameters: {'id': 'f00fe4cac7c546429ca3650311ac8fbb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 08 20:34:32.845154 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94742) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 08 20:34:32.862399 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-85277660-fde2-4001-92ec-00eb06eeb4e1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f00fe4cac7c546429ca3650311ac8fbb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f00fe4cac7c546429ca3650311ac8fbb. Oct 08 20:34:32.862399 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:32.862399 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:34:32.862399 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 08 20:34:32.862399 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:34:32.862399 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 08 20:34:32.862399 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:34:32.862399 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application result = self._query(query) Oct 08 20:34:32.862399 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:34:32.862399 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application conn.query(q) Oct 08 20:34:32.862399 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:34:32.862399 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:34:32.862399 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application result.read() Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 08 20:34:32.863482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application next(self.gen) Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application yield resource Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application next(self.gen) Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self.session.rollback() Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self.force_reraise() Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise self.value Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application session.commit() Oct 08 20:34:32.864600 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._prepare_impl() Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self.session.flush() Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._flush(objects) Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application compat.raise_( Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application flush_context.execute() Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 08 20:34:32.865565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rec.execute(self) Oct 08 20:34:32.866807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 08 20:34:32.866807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 08 20:34:32.866807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 08 20:34:32.866807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 08 20:34:32.866807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 08 20:34:32.866807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 08 20:34:32.866807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 08 20:34:32.866807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 08 20:34:32.866807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 08 20:34:32.866807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 08 20:34:32.866807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 08 20:34:32.866807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 08 20:34:32.866807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 08 20:34:32.866807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 08 20:34:32.866807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application result = self._query(query) Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application conn.query(q) Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application result.read() Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:34:32.867847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 08 20:34:32.869237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:34:32.869237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 08 20:34:32.869237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:34:32.869237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 08 20:34:32.869237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:34:32.869237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 08 20:34:32.869237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 08 20:34:32.869237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 08 20:34:32.869237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [parameters: {'id': 'f00fe4cac7c546429ca3650311ac8fbb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 08 20:34:32.869237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 08 20:34:32.869237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:32.869237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:32.869237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:32.869237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:32.869237 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:32.870285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:32.871467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:32.871467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 08 20:34:32.871467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 08 20:34:32.871467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:32.871467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:32.871467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 08 20:34:32.871467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 08 20:34:32.871467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f00fe4cac7c546429ca3650311ac8fbb. Oct 08 20:34:32.871467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:32.871467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 401/798] 10.222.0.36 () {60 vars in 1140 bytes} [Sat Oct 8 20:34:32 2022] POST /identity/v3/projects => generated 262 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:32.873264 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5475c69-4144-462b-91ae-3129eda9da26 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:32.968383 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5475c69-4144-462b-91ae-3129eda9da26 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:32.983941 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:33.001943 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370ca06-ab75-469b-aafd-d62d1bf59e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:33.002565 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370ca06-ab75-469b-aafd-d62d1bf59e12 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:33.002843 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370ca06-ab75-469b-aafd-d62d1bf59e12 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:33.003113 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370ca06-ab75-469b-aafd-d62d1bf59e12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:33.009355 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370ca06-ab75-469b-aafd-d62d1bf59e12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:33.010818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370ca06-ab75-469b-aafd-d62d1bf59e12 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:33.021740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-1370ca06-ab75-469b-aafd-d62d1bf59e12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:34:33.021740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:33.021740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:33.021740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:33.021740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:33.021740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:33.021740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:33.021740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:33.021740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:33.021740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:33.021740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:33.021740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:33.021740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:34:33.021740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:34:33.021740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:33.022829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:33.023881 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:34:33.023881 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:34:33.023881 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:34:33.023881 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:34:33.023881 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:34:33.023881 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:34:33.023881 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:34:33.023881 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:33.023881 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 398/799] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:34:33.028750 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85277660-fde2-4001-92ec-00eb06eeb4e1 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:33.039966 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:33.132855 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85277660-fde2-4001-92ec-00eb06eeb4e1 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:33.166244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f84274-9f72-4ff7-be67-62bd9d7f2ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:33.166846 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f84274-9f72-4ff7-be67-62bd9d7f2ba4 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:33.167124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f84274-9f72-4ff7-be67-62bd9d7f2ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:33.167389 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f84274-9f72-4ff7-be67-62bd9d7f2ba4 None admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:33.168045 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f84274-9f72-4ff7-be67-62bd9d7f2ba4 None admin] RBAC: Adding query filter params (name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:33.168347 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f84274-9f72-4ff7-be67-62bd9d7f2ba4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:33.169978 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f84274-9f72-4ff7-be67-62bd9d7f2ba4 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:33.189852 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 402/800] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Oct 8 20:34:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:33.825084 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50698a1-7a91-46e8-8efe-8a85fb26866b None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:33.825641 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50698a1-7a91-46e8-8efe-8a85fb26866b None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:33.825641 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50698a1-7a91-46e8-8efe-8a85fb26866b None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:33.826995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 399/801] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:33.832911 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaeed3-285d-46bc-9df6-b2c043614bad None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:33.833331 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaeed3-285d-46bc-9df6-b2c043614bad None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:33.833490 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaeed3-285d-46bc-9df6-b2c043614bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:33.852381 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-eceaeed3-285d-46bc-9df6-b2c043614bad None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:33.854056 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-eceaeed3-285d-46bc-9df6-b2c043614bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:33.912204 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:33.919960 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 403/802] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:33 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:34.240184 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50698a1-7a91-46e8-8efe-8a85fb26866b None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:34.341331 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50698a1-7a91-46e8-8efe-8a85fb26866b None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:34.374219 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc3d88-a61d-49da-975a-0f0bbb83a1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:34.374826 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc3d88-a61d-49da-975a-0f0bbb83a1d9 None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:34.375105 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc3d88-a61d-49da-975a-0f0bbb83a1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:34.375378 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc3d88-a61d-49da-975a-0f0bbb83a1d9 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:34.376124 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc3d88-a61d-49da-975a-0f0bbb83a1d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:34.377485 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc3d88-a61d-49da-975a-0f0bbb83a1d9 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:34.391889 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 400/803] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Oct 8 20:34:34 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:35.652906 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11244d-e1f8-4868-bfbd-e1d0793328b6 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:35.653438 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11244d-e1f8-4868-bfbd-e1d0793328b6 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:35.653438 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11244d-e1f8-4868-bfbd-e1d0793328b6 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:35.654817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 404/804] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:35.660842 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be83f0-4ce7-466a-a673-f6b724127a4f None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:35.661287 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be83f0-4ce7-466a-a673-f6b724127a4f None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:35.661516 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be83f0-4ce7-466a-a673-f6b724127a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:35.680294 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-c4be83f0-4ce7-466a-a673-f6b724127a4f None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:35.681484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-c4be83f0-4ce7-466a-a673-f6b724127a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:35.709040 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:35.754450 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 401/805] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:35 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:36.081329 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11244d-e1f8-4868-bfbd-e1d0793328b6 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:36.181875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11244d-e1f8-4868-bfbd-e1d0793328b6 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:36.224646 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c14d4d-6494-46eb-9387-acb97ef55170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:36.225303 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c14d4d-6494-46eb-9387-acb97ef55170 None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:36.225589 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c14d4d-6494-46eb-9387-acb97ef55170 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:36.225863 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c14d4d-6494-46eb-9387-acb97ef55170 None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:36.226538 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c14d4d-6494-46eb-9387-acb97ef55170 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:36.227963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c14d4d-6494-46eb-9387-acb97ef55170 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:36.243968 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.sql.core [None req-d5c14d4d-6494-46eb-9387-acb97ef55170 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 08 20:34:36.243968 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 08 20:34:36.243968 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [parameters: {'user_id': '825d4282ed8743dbb5999f986a401a76', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 08 20:34:36.243968 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94742) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 08 20:34:36.251977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-d5c14d4d-6494-46eb-9387-acb97ef55170 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 08 20:34:36.251977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:36.251977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:34:36.251977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 08 20:34:36.251977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:34:36.251977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 08 20:34:36.251977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:34:36.251977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application result = self._query(query) Oct 08 20:34:36.251977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:34:36.251977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application conn.query(q) Oct 08 20:34:36.251977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:34:36.251977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:34:36.251977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:34:36.251977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application result.read() Oct 08 20:34:36.251977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 20:34:36.252896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application next(self.gen) Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application yield resource Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application next(self.gen) Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self.session.rollback() Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self.force_reraise() Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise self.value Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application session.commit() Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 08 20:34:36.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._prepare_impl() Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self.session.flush() Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._flush(objects) Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application compat.raise_( Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application flush_context.execute() Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rec.execute(self) Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 08 20:34:36.256057 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 08 20:34:36.257153 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application result = self._query(query) Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application conn.query(q) Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application result.read() Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 08 20:34:36.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 08 20:34:36.259252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 08 20:34:36.259252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 08 20:34:36.259252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 08 20:34:36.259252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 08 20:34:36.259252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 08 20:34:36.259252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 08 20:34:36.259252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [parameters: {'user_id': '825d4282ed8743dbb5999f986a401a76', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 08 20:34:36.259252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 08 20:34:36.259252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:36.259252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:36.259252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:36.259252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:36.259252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:36.259252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:36.259252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 08 20:34:36.260236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 08 20:34:36.261387 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 08 20:34:36.261387 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 08 20:34:36.261387 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 08 20:34:36.261387 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 08 20:34:36.261387 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 08 20:34:36.261387 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:36.261387 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 405/806] 10.222.0.36 () {60 vars in 1131 bytes} [Sat Oct 8 20:34:36 2022] POST /identity/v3/users => generated 160 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:36.261819 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be83f0-4ce7-466a-a673-f6b724127a4f None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:36.363175 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be83f0-4ce7-466a-a673-f6b724127a4f None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:36.403986 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f48491-770d-479d-8fe2-da74ea6160b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:36.404877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f48491-770d-479d-8fe2-da74ea6160b5 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:36.405340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f48491-770d-479d-8fe2-da74ea6160b5 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:36.405757 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f48491-770d-479d-8fe2-da74ea6160b5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:36.414157 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f48491-770d-479d-8fe2-da74ea6160b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:36.415794 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f48491-770d-479d-8fe2-da74ea6160b5 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-d8f48491-770d-479d-8fe2-da74ea6160b5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:34:36.428092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:36.429160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:36.434835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:36.434835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:36.434835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:34:36.434835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:34:36.434835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:34:36.434835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:34:36.434835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:34:36.434835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:34:36.434835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 08 20:34:36.434835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:36.434835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 402/807] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:34:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:36.435444 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c14d4d-6494-46eb-9387-acb97ef55170 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:36.498920 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:36.541765 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c14d4d-6494-46eb-9387-acb97ef55170 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:36.574761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2effefd-2d3d-4697-abf5-098dcfbd89e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:36.575364 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2effefd-2d3d-4697-abf5-098dcfbd89e5 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:36.575647 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2effefd-2d3d-4697-abf5-098dcfbd89e5 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:36.575922 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2effefd-2d3d-4697-abf5-098dcfbd89e5 None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:36.576614 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2effefd-2d3d-4697-abf5-098dcfbd89e5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:36.576918 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2effefd-2d3d-4697-abf5-098dcfbd89e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:36.578583 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2effefd-2d3d-4697-abf5-098dcfbd89e5 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:36.619023 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 406/808] 10.222.0.36 () {56 vars in 1101 bytes} [Sat Oct 8 20:34:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:34:36.811340 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99e0e7-3ea3-4e78-8ef2-7923c0df8b18 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:36.811873 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99e0e7-3ea3-4e78-8ef2-7923c0df8b18 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:36.811873 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99e0e7-3ea3-4e78-8ef2-7923c0df8b18 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:36.813217 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 403/809] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:36.818940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40e734-279d-4723-af17-05659182990e None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:36.819394 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40e734-279d-4723-af17-05659182990e None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:36.819494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40e734-279d-4723-af17-05659182990e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:36.838489 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-bf40e734-279d-4723-af17-05659182990e None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:36.840025 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-bf40e734-279d-4723-af17-05659182990e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:36.908397 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 407/810] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:36 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:34:37.229061 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99e0e7-3ea3-4e78-8ef2-7923c0df8b18 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:37.253680 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:37.326252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99e0e7-3ea3-4e78-8ef2-7923c0df8b18 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:37.358180 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d4063-69bc-4c26-bea1-d9fdfcc9f2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:37.358790 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d4063-69bc-4c26-bea1-d9fdfcc9f2cb None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:37.359065 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d4063-69bc-4c26-bea1-d9fdfcc9f2cb None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:37.359334 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d4063-69bc-4c26-bea1-d9fdfcc9f2cb None admin] PATH_INFO: `/v3/services/compute` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:37.359900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d4063-69bc-4c26-bea1-d9fdfcc9f2cb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:37.361778 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d4063-69bc-4c26-bea1-d9fdfcc9f2cb None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-758d4063-69bc-4c26-bea1-d9fdfcc9f2cb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:37.370194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:37.371393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:37.372461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:37.372461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:37.372461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:37.372461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:37.372461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:37.372461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:37.372461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:37.372461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:37.372461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:37.372461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:37.372461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:37.372461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:37.372461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:34:37.372461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:34:37.372461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 404/811] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:37.377726 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40e734-279d-4723-af17-05659182990e None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:37.420902 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:37.471945 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40e734-279d-4723-af17-05659182990e None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:37.505265 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f123e6c-f2bc-4a5c-97a0-081f9f0f2fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:37.505805 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f123e6c-f2bc-4a5c-97a0-081f9f0f2fe3 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:37.506112 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f123e6c-f2bc-4a5c-97a0-081f9f0f2fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:37.506386 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f123e6c-f2bc-4a5c-97a0-081f9f0f2fe3 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:37.507001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f123e6c-f2bc-4a5c-97a0-081f9f0f2fe3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:37.507302 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f123e6c-f2bc-4a5c-97a0-081f9f0f2fe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:37.508651 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f123e6c-f2bc-4a5c-97a0-081f9f0f2fe3 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:37.513259 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 408/812] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Oct 8 20:34:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:37.518857 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d4063-69bc-4c26-bea1-d9fdfcc9f2cb None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:37.600190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:37.615651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d4063-69bc-4c26-bea1-d9fdfcc9f2cb None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:37.647887 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87137b5a-f75d-439f-9fde-347a6d197b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:37.648484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87137b5a-f75d-439f-9fde-347a6d197b13 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:37.648765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87137b5a-f75d-439f-9fde-347a6d197b13 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:37.649033 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87137b5a-f75d-439f-9fde-347a6d197b13 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:37.649648 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87137b5a-f75d-439f-9fde-347a6d197b13 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:37.649975 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87137b5a-f75d-439f-9fde-347a6d197b13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:37.651304 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87137b5a-f75d-439f-9fde-347a6d197b13 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:37.655778 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 405/813] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Oct 8 20:34:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:37.661933 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f123e6c-f2bc-4a5c-97a0-081f9f0f2fe3 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:37.758874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f123e6c-f2bc-4a5c-97a0-081f9f0f2fe3 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:37.769330 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:37.792633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9754516-a756-4a0e-8a88-5289cd91ccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:37.793225 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9754516-a756-4a0e-8a88-5289cd91ccc0 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:37.793501 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9754516-a756-4a0e-8a88-5289cd91ccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:37.793770 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9754516-a756-4a0e-8a88-5289cd91ccc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:37.794482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9754516-a756-4a0e-8a88-5289cd91ccc0 None admin] RBAC: Adding query filter params (interface=public, service_id=1ebdcfc8225442e79f694e86460e797e, region_id=RegionOne) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:37.794792 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9754516-a756-4a0e-8a88-5289cd91ccc0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:37.796140 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9754516-a756-4a0e-8a88-5289cd91ccc0 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:37.801483 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 409/814] 10.222.0.36 () {56 vars in 1251 bytes} [Sat Oct 8 20:34:37 2022] GET /identity/v3/endpoints?service_id=1ebdcfc8225442e79f694e86460e797e&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:37.807174 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87137b5a-f75d-439f-9fde-347a6d197b13 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:37.902298 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87137b5a-f75d-439f-9fde-347a6d197b13 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:37.934528 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902406ad-c7a6-45a1-b777-dbcb0cebad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:37.935130 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902406ad-c7a6-45a1-b777-dbcb0cebad97 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:37.935410 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902406ad-c7a6-45a1-b777-dbcb0cebad97 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:37.935683 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902406ad-c7a6-45a1-b777-dbcb0cebad97 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:37.936273 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902406ad-c7a6-45a1-b777-dbcb0cebad97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:37.937606 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902406ad-c7a6-45a1-b777-dbcb0cebad97 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:37.943635 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 406/815] 10.222.0.36 () {56 vars in 1087 bytes} [Sat Oct 8 20:34:37 2022] GET /identity/v3/services => generated 1728 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:34:40.307747 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b364895-89b7-4f29-8618-95bd9071cc54 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:40.308263 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b364895-89b7-4f29-8618-95bd9071cc54 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:40.308263 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b364895-89b7-4f29-8618-95bd9071cc54 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:40.309532 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 410/816] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:34:40.315199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4c2fd-c411-403d-bd59-9132f40b3be9 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:40.315610 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4c2fd-c411-403d-bd59-9132f40b3be9 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:40.315746 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4c2fd-c411-403d-bd59-9132f40b3be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:40.334150 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-7fd4c2fd-c411-403d-bd59-9132f40b3be9 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:34:40.335321 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-7fd4c2fd-c411-403d-bd59-9132f40b3be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:34:40.344130 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:40.399150 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 407/817] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:34:40 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:34:40.718663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b364895-89b7-4f29-8618-95bd9071cc54 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:40.818178 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b364895-89b7-4f29-8618-95bd9071cc54 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:40.850588 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a40f3-2760-4c70-85ff-8ce404e5fc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:40.851235 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a40f3-2760-4c70-85ff-8ce404e5fc21 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:40.851510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a40f3-2760-4c70-85ff-8ce404e5fc21 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:40.851776 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a40f3-2760-4c70-85ff-8ce404e5fc21 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:40.852341 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a40f3-2760-4c70-85ff-8ce404e5fc21 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:40.853682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a40f3-2760-4c70-85ff-8ce404e5fc21 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-b03a40f3-2760-4c70-85ff-8ce404e5fc21 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:34:40.863160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:34:40.864146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:34:40.865044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:34:40.865044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:34:40.865044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:34:40.865044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:34:40.865044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:34:40.865044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:34:40.865044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:34:40.865044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:34:40.865044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:34:40.865044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:34:40.865044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:34:40.865044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:34:40.865044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 08 20:34:40.865044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:34:40.865044 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 411/818] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:34:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:34:40.870313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4c2fd-c411-403d-bd59-9132f40b3be9 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:40.963774 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4c2fd-c411-403d-bd59-9132f40b3be9 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:40.997758 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4bb8-b20e-4699-943b-f27f4d01f44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:40.998326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4bb8-b20e-4699-943b-f27f4d01f44c None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:40.998607 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4bb8-b20e-4699-943b-f27f4d01f44c None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:40.998879 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4bb8-b20e-4699-943b-f27f4d01f44c None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:40.999494 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f4bb8-b20e-4699-943b-f27f4d01f44c None admin] RBAC: Adding query filter params (name=compute) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:40.999798 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f4bb8-b20e-4699-943b-f27f4d01f44c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:41.001164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f4bb8-b20e-4699-943b-f27f4d01f44c None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:41.005653 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 408/819] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Oct 8 20:34:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:41.011476 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a40f3-2760-4c70-85ff-8ce404e5fc21 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:41.050307 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:41.110267 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a40f3-2760-4c70-85ff-8ce404e5fc21 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:41.142449 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23eb4d0-b7bb-4db7-a25c-10be2fe99a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:41.143052 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eb4d0-b7bb-4db7-a25c-10be2fe99a86 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:41.143337 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eb4d0-b7bb-4db7-a25c-10be2fe99a86 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:41.143611 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eb4d0-b7bb-4db7-a25c-10be2fe99a86 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:41.144234 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23eb4d0-b7bb-4db7-a25c-10be2fe99a86 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:34:41.144535 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23eb4d0-b7bb-4db7-a25c-10be2fe99a86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:41.145877 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23eb4d0-b7bb-4db7-a25c-10be2fe99a86 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:41.150710 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 412/820] 10.222.0.36 () {56 vars in 1112 bytes} [Sat Oct 8 20:34:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:34:41.156404 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4bb8-b20e-4699-943b-f27f4d01f44c None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:34:41.167894 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:41.254191 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4bb8-b20e-4699-943b-f27f4d01f44c None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:34:41.285752 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e176c8-8193-4696-8bc0-67362a6bb435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:34:41.286371 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e176c8-8193-4696-8bc0-67362a6bb435 None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:34:41.286654 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e176c8-8193-4696-8bc0-67362a6bb435 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:34:41.286925 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e176c8-8193-4696-8bc0-67362a6bb435 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:34:41.287575 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e176c8-8193-4696-8bc0-67362a6bb435 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:34:41.288917 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e176c8-8193-4696-8bc0-67362a6bb435 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:34:41.307447 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 409/821] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Oct 8 20:34:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:34:51.148161 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=49 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:34:51.303463 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:44.480984 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ac9aa-e20e-4cae-b75f-e9e234851172 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:44.481602 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ac9aa-e20e-4cae-b75f-e9e234851172 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:44.481602 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ac9aa-e20e-4cae-b75f-e9e234851172 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:44.484006 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 413/822] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:44.490141 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1728e-85c8-4074-b804-af0d60bef162 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:44.490618 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1728e-85c8-4074-b804-af0d60bef162 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:44.490721 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1728e-85c8-4074-b804-af0d60bef162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:44.511279 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-aef1728e-85c8-4074-b804-af0d60bef162 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:44.512763 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-aef1728e-85c8-4074-b804-af0d60bef162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:44.613907 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 410/823] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:44 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:35:44.975976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ac9aa-e20e-4cae-b75f-e9e234851172 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:45.096335 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ac9aa-e20e-4cae-b75f-e9e234851172 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:45.136104 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ec2f9-6c9a-486b-9f36-4cc14b9ae18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:45.136758 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ec2f9-6c9a-486b-9f36-4cc14b9ae18c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:45.137034 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ec2f9-6c9a-486b-9f36-4cc14b9ae18c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:45.137303 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ec2f9-6c9a-486b-9f36-4cc14b9ae18c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:45.152273 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ec2f9-6c9a-486b-9f36-4cc14b9ae18c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:45.153872 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ec2f9-6c9a-486b-9f36-4cc14b9ae18c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-236ec2f9-6c9a-486b-9f36-4cc14b9ae18c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:45.172804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:45.173963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:45.174985 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:45.174985 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:45.174985 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:35:45.174985 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 414/824] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:45.180899 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1728e-85c8-4074-b804-af0d60bef162 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:45.301321 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1728e-85c8-4074-b804-af0d60bef162 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:45.337225 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:45.349915 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666363f-c3e5-4658-b4f2-4a32e545eea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:45.350709 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666363f-c3e5-4658-b4f2-4a32e545eea6 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:45.351005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666363f-c3e5-4658-b4f2-4a32e545eea6 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:45.351280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666363f-c3e5-4658-b4f2-4a32e545eea6 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:45.351931 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666363f-c3e5-4658-b4f2-4a32e545eea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:45.352283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666363f-c3e5-4658-b4f2-4a32e545eea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:45.353766 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666363f-c3e5-4658-b4f2-4a32e545eea6 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:45.377539 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 411/825] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:45.378917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ec2f9-6c9a-486b-9f36-4cc14b9ae18c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:45.453232 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:45.516629 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ec2f9-6c9a-486b-9f36-4cc14b9ae18c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:45.557351 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f798f-06bf-4a19-b30b-2b96ccb3f4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:45.557898 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f798f-06bf-4a19-b30b-2b96ccb3f4ce None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:45.558190 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f798f-06bf-4a19-b30b-2b96ccb3f4ce None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:45.558461 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f798f-06bf-4a19-b30b-2b96ccb3f4ce None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:45.559469 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f798f-06bf-4a19-b30b-2b96ccb3f4ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:45.560512 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f798f-06bf-4a19-b30b-2b96ccb3f4ce None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:45.595222 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 415/826] 10.222.0.36 () {60 vars in 1132 bytes} [Sat Oct 8 20:35:45 2022] POST /identity/v3/users => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:35:48.277396 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b8b22-ed14-4df6-baa7-783774646838 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:48.277973 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b8b22-ed14-4df6-baa7-783774646838 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:48.277973 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b8b22-ed14-4df6-baa7-783774646838 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:48.279432 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 412/827] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:48.285115 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355955e-faca-4286-8a57-46af76e00ce6 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:48.285572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355955e-faca-4286-8a57-46af76e00ce6 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:48.285901 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355955e-faca-4286-8a57-46af76e00ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:48.307616 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-e355955e-faca-4286-8a57-46af76e00ce6 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:48.308856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-e355955e-faca-4286-8a57-46af76e00ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:48.381142 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 416/828] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:48 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:35:48.744850 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b8b22-ed14-4df6-baa7-783774646838 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:48.862329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b8b22-ed14-4df6-baa7-783774646838 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:48.898224 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb9113-d6ac-4911-8dd2-b7c2e3003ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:48.898857 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb9113-d6ac-4911-8dd2-b7c2e3003ffa None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:48.899136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb9113-d6ac-4911-8dd2-b7c2e3003ffa None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:48.899408 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb9113-d6ac-4911-8dd2-b7c2e3003ffa None admin] PATH_INFO: `/v3/roles/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:48.910052 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb9113-d6ac-4911-8dd2-b7c2e3003ffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-7ecb9113-d6ac-4911-8dd2-b7c2e3003ffa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:48.917004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:48.918067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:48.918067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:48.918067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:48.918067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:48.918067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:48.918067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:48.918067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:48.918067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:48.918067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:48.918067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:48.918067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:48.918067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:35:48.918067 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 413/829] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:48.924106 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355955e-faca-4286-8a57-46af76e00ce6 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:48.967711 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:49.035977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355955e-faca-4286-8a57-46af76e00ce6 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:49.075866 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b1193-b6aa-4e8a-ab58-8112dddb7311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:49.076488 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b1193-b6aa-4e8a-ab58-8112dddb7311 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.076920 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b1193-b6aa-4e8a-ab58-8112dddb7311 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.077233 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b1193-b6aa-4e8a-ab58-8112dddb7311 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.077935 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b1193-b6aa-4e8a-ab58-8112dddb7311 None admin] RBAC: Adding query filter params (name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:49.078244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b1193-b6aa-4e8a-ab58-8112dddb7311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:49.079610 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b1193-b6aa-4e8a-ab58-8112dddb7311 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:49.088784 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 417/830] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:49.095964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb9113-d6ac-4911-8dd2-b7c2e3003ffa None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:49.148477 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:49.205462 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb9113-d6ac-4911-8dd2-b7c2e3003ffa None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:49.246816 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b0e5f-0992-4f3c-87ba-03320aa8d64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:49.247449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b0e5f-0992-4f3c-87ba-03320aa8d64f None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.247731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b0e5f-0992-4f3c-87ba-03320aa8d64f None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.248006 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b0e5f-0992-4f3c-87ba-03320aa8d64f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.259166 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b0e5f-0992-4f3c-87ba-03320aa8d64f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:49.260764 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b0e5f-0992-4f3c-87ba-03320aa8d64f None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-ce0b0e5f-0992-4f3c-87ba-03320aa8d64f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:49.276177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:49.277210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:49.278620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:49.278620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:49.278620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:35:49.278620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 414/831] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:49.283744 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b1193-b6aa-4e8a-ab58-8112dddb7311 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:49.393574 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:49.396562 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b1193-b6aa-4e8a-ab58-8112dddb7311 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:49.431676 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e1af7-bfc8-456d-a1df-8a47e2c6709d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:49.432273 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1af7-bfc8-456d-a1df-8a47e2c6709d None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.432554 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1af7-bfc8-456d-a1df-8a47e2c6709d None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.432829 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1af7-bfc8-456d-a1df-8a47e2c6709d None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.433468 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e1af7-bfc8-456d-a1df-8a47e2c6709d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:49.433757 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e1af7-bfc8-456d-a1df-8a47e2c6709d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:49.435133 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e1af7-bfc8-456d-a1df-8a47e2c6709d None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:49.447450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 418/832] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:49.453805 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b0e5f-0992-4f3c-87ba-03320aa8d64f None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:49.554923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:49.558483 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b0e5f-0992-4f3c-87ba-03320aa8d64f None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:49.593739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f05ca2-e4c4-4734-9546-8af753adc383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:49.594551 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f05ca2-e4c4-4734-9546-8af753adc383 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.594865 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f05ca2-e4c4-4734-9546-8af753adc383 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.595220 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f05ca2-e4c4-4734-9546-8af753adc383 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.603963 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f05ca2-e4c4-4734-9546-8af753adc383 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:49.605704 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f05ca2-e4c4-4734-9546-8af753adc383 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-61f05ca2-e4c4-4734-9546-8af753adc383 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:49.619456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:49.620589 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:49.621651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:49.621651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:49.621651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:49.621651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:49.621651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:49.621651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:49.621651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:49.621651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:49.621651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:35:49.621651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:35:49.621651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 415/833] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:49.627090 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e1af7-bfc8-456d-a1df-8a47e2c6709d None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:49.736114 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e1af7-bfc8-456d-a1df-8a47e2c6709d None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:49.771931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44347507-e07d-446b-b2af-6cc47204492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:49.772612 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44347507-e07d-446b-b2af-6cc47204492e None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.772938 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44347507-e07d-446b-b2af-6cc47204492e None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.773247 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44347507-e07d-446b-b2af-6cc47204492e None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.774096 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44347507-e07d-446b-b2af-6cc47204492e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:49.774425 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44347507-e07d-446b-b2af-6cc47204492e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:49.775954 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44347507-e07d-446b-b2af-6cc47204492e None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:49.794311 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 419/834] 10.222.0.36 () {56 vars in 1143 bytes} [Sat Oct 8 20:35:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:49.800888 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f05ca2-e4c4-4734-9546-8af753adc383 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:49.907660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f05ca2-e4c4-4734-9546-8af753adc383 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:49.942510 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2730a-f80f-44ab-a1a8-c35a709f10d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:49.943434 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2730a-f80f-44ab-a1a8-c35a709f10d5 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:49.943829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2730a-f80f-44ab-a1a8-c35a709f10d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:49.944141 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2730a-f80f-44ab-a1a8-c35a709f10d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:49.975431 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:50.021372 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2730a-f80f-44ab-a1a8-c35a709f10d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:50.022920 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2730a-f80f-44ab-a1a8-c35a709f10d5 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:50.138198 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 416/835] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:35:49 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:35:50.144669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44347507-e07d-446b-b2af-6cc47204492e None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:50.163830 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:50.254133 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44347507-e07d-446b-b2af-6cc47204492e None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:50.293321 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f3efb-7432-4b01-b2aa-7c239a546ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:50.294252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3efb-7432-4b01-b2aa-7c239a546ea5 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:50.294531 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3efb-7432-4b01-b2aa-7c239a546ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:50.294848 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3efb-7432-4b01-b2aa-7c239a546ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:50.306726 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f3efb-7432-4b01-b2aa-7c239a546ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:50.308415 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f3efb-7432-4b01-b2aa-7c239a546ea5 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-402f3efb-7432-4b01-b2aa-7c239a546ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:50.324289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:50.330797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:50.331952 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:50.331952 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:50.331952 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:35:50.331952 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 420/836] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:35:50.332275 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2730a-f80f-44ab-a1a8-c35a709f10d5 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:50.395294 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:50.442328 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2730a-f80f-44ab-a1a8-c35a709f10d5 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:50.475876 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b3ce0-2bd0-45ba-8087-1b4ba8fe41b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:50.476482 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b3ce0-2bd0-45ba-8087-1b4ba8fe41b5 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:50.476768 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b3ce0-2bd0-45ba-8087-1b4ba8fe41b5 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:50.477044 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b3ce0-2bd0-45ba-8087-1b4ba8fe41b5 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:50.477679 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b3ce0-2bd0-45ba-8087-1b4ba8fe41b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:50.478017 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b3ce0-2bd0-45ba-8087-1b4ba8fe41b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:50.479536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b3ce0-2bd0-45ba-8087-1b4ba8fe41b5 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:50.493555 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 417/837] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:50.499546 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f3efb-7432-4b01-b2aa-7c239a546ea5 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:50.579341 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:50.617847 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f3efb-7432-4b01-b2aa-7c239a546ea5 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:50.658249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544ac72-6013-4be6-a39f-a70b0f7f5fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:50.659018 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ac72-6013-4be6-a39f-a70b0f7f5fe0 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:50.659343 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ac72-6013-4be6-a39f-a70b0f7f5fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:50.659621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ac72-6013-4be6-a39f-a70b0f7f5fe0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:50.667366 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544ac72-6013-4be6-a39f-a70b0f7f5fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:50.669062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544ac72-6013-4be6-a39f-a70b0f7f5fe0 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:50.682703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-8544ac72-6013-4be6-a39f-a70b0f7f5fe0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:50.682703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:50.682703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:50.682703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:50.682703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:50.682703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:50.682703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:50.682703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:50.682703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:50.682703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:50.682703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:50.682703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:50.682703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:50.682703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:50.682703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:50.683875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:50.684930 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:50.684930 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:50.684930 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:50.684930 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:50.684930 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:50.684930 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:50.684930 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:50.684930 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:35:50.684930 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 421/838] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:50.691277 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b3ce0-2bd0-45ba-8087-1b4ba8fe41b5 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:50.813004 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b3ce0-2bd0-45ba-8087-1b4ba8fe41b5 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:50.831399 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:50.850096 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eec79-5393-49ee-bd04-a4d6e2986910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:50.850766 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eec79-5393-49ee-bd04-a4d6e2986910 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:50.851068 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eec79-5393-49ee-bd04-a4d6e2986910 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:50.851848 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eec79-5393-49ee-bd04-a4d6e2986910 None admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:50.852842 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2eec79-5393-49ee-bd04-a4d6e2986910 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:50.853200 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2eec79-5393-49ee-bd04-a4d6e2986910 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:50.854996 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2eec79-5393-49ee-bd04-a4d6e2986910 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:50.869986 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 418/839] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:50.876989 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544ac72-6013-4be6-a39f-a70b0f7f5fe0 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:50.985706 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544ac72-6013-4be6-a39f-a70b0f7f5fe0 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:51.016684 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:51.022665 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518e3cd-4204-4268-aba3-98ade605657a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:51.023265 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518e3cd-4204-4268-aba3-98ade605657a None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:51.023543 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518e3cd-4204-4268-aba3-98ade605657a None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:51.023813 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518e3cd-4204-4268-aba3-98ade605657a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:51.024524 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518e3cd-4204-4268-aba3-98ade605657a None admin] RBAC: Adding query filter params (role.id=b849f9edba724fe5a0d7d1e8da249400, scope.project.id=bac7915cef1d4e3288a30fd015fcce50, user.id=9fc15a49c674447d9d85b17eb70c3db3) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:51.024830 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518e3cd-4204-4268-aba3-98ade605657a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:51.026277 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518e3cd-4204-4268-aba3-98ade605657a None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:51.031615 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 422/840] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:35:50 2022] GET /identity/v3/role_assignments?user.id=9fc15a49c674447d9d85b17eb70c3db3&scope.project.id=bac7915cef1d4e3288a30fd015fcce50&role.id=b849f9edba724fe5a0d7d1e8da249400 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:53.541848 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfb35a-151f-4cad-b9c6-b0d1671832d0 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:53.542483 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfb35a-151f-4cad-b9c6-b0d1671832d0 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:53.542483 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfb35a-151f-4cad-b9c6-b0d1671832d0 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:53.543757 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 419/841] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:53.548996 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e1ed6-34a0-4fb9-9b8a-60b87323411a None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:53.549464 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e1ed6-34a0-4fb9-9b8a-60b87323411a None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:53.549561 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e1ed6-34a0-4fb9-9b8a-60b87323411a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:53.571301 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-0d4e1ed6-34a0-4fb9-9b8a-60b87323411a None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:53.572481 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-0d4e1ed6-34a0-4fb9-9b8a-60b87323411a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:53.650873 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 423/842] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:53 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:35:53.973060 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfb35a-151f-4cad-b9c6-b0d1671832d0 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:54.086567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfb35a-151f-4cad-b9c6-b0d1671832d0 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:54.124175 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523ae4b-5a30-422c-a37d-3fbcc380ddfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:54.124794 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523ae4b-5a30-422c-a37d-3fbcc380ddfb None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:54.125066 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523ae4b-5a30-422c-a37d-3fbcc380ddfb None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:54.125319 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523ae4b-5a30-422c-a37d-3fbcc380ddfb None admin] PATH_INFO: `/v3/roles/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:54.135765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523ae4b-5a30-422c-a37d-3fbcc380ddfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-5523ae4b-5a30-422c-a37d-3fbcc380ddfb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:54.141407 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:54.142630 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:54.143691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:54.143691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:54.143691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:54.143691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:54.143691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:54.143691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:54.143691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:54.143691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:54.143691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:54.143691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:54.143691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:54.143691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:35:54.147703 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 420/843] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:54.148935 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e1ed6-34a0-4fb9-9b8a-60b87323411a None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:54.260849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e1ed6-34a0-4fb9-9b8a-60b87323411a None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:54.285175 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:54.298161 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f76b6-163f-4ee9-af96-8a5de76cd4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:54.298775 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f76b6-163f-4ee9-af96-8a5de76cd4cd None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:54.299049 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f76b6-163f-4ee9-af96-8a5de76cd4cd None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:54.299317 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f76b6-163f-4ee9-af96-8a5de76cd4cd None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:54.299974 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f76b6-163f-4ee9-af96-8a5de76cd4cd None admin] RBAC: Adding query filter params (name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:54.300273 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f76b6-163f-4ee9-af96-8a5de76cd4cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:54.301662 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f76b6-163f-4ee9-af96-8a5de76cd4cd None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:54.310144 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 424/844] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:54.315805 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523ae4b-5a30-422c-a37d-3fbcc380ddfb None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:54.365299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:54.429942 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523ae4b-5a30-422c-a37d-3fbcc380ddfb None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:54.469581 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b4531-db19-434a-8c3d-6eb6939f91ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:54.470381 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b4531-db19-434a-8c3d-6eb6939f91ea None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:54.470673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b4531-db19-434a-8c3d-6eb6939f91ea None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:54.470940 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b4531-db19-434a-8c3d-6eb6939f91ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:54.481708 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b4531-db19-434a-8c3d-6eb6939f91ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:54.484120 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b4531-db19-434a-8c3d-6eb6939f91ea None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-178b4531-db19-434a-8c3d-6eb6939f91ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:54.499427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:54.500631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:54.501830 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:54.501830 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:54.501830 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:35:54.501830 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 421/845] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:54.506911 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f76b6-163f-4ee9-af96-8a5de76cd4cd None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:54.620845 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f76b6-163f-4ee9-af96-8a5de76cd4cd None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:54.657191 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2d8f9-2caf-4417-a31a-e5c587474b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:54.657798 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2d8f9-2caf-4417-a31a-e5c587474b5b None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:54.658102 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2d8f9-2caf-4417-a31a-e5c587474b5b None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:54.658373 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2d8f9-2caf-4417-a31a-e5c587474b5b None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:54.659008 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2d8f9-2caf-4417-a31a-e5c587474b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:54.659309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2d8f9-2caf-4417-a31a-e5c587474b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:54.660648 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2d8f9-2caf-4417-a31a-e5c587474b5b None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:54.672941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 425/846] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:54.679223 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b4531-db19-434a-8c3d-6eb6939f91ea None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:54.776381 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:54.788509 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b4531-db19-434a-8c3d-6eb6939f91ea None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:54.826485 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0978b-644d-43ce-9a28-f61162ed8add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:54.827115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0978b-644d-43ce-9a28-f61162ed8add None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:54.827395 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0978b-644d-43ce-9a28-f61162ed8add None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:54.827669 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0978b-644d-43ce-9a28-f61162ed8add None admin] PATH_INFO: `/v3/users/placement` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:54.835199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0978b-644d-43ce-9a28-f61162ed8add None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:54.836613 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0978b-644d-43ce-9a28-f61162ed8add None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-d2e0978b-644d-43ce-9a28-f61162ed8add None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:35:54.849812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:54.855615 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:54.857517 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:54.857517 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:54.857517 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:35:54.857517 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:35:54.857517 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:35:54.857517 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:35:54.857517 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:35:54.857517 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:35:54.857517 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:35:54.857517 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:35:54.857517 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 422/847] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:35:54.858829 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2d8f9-2caf-4417-a31a-e5c587474b5b None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:54.907601 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:54.963151 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2d8f9-2caf-4417-a31a-e5c587474b5b None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:55.000792 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43991bc-fc81-4de2-91a6-942ba17ebc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:55.001397 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43991bc-fc81-4de2-91a6-942ba17ebc79 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.001679 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43991bc-fc81-4de2-91a6-942ba17ebc79 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.001980 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43991bc-fc81-4de2-91a6-942ba17ebc79 None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.002704 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43991bc-fc81-4de2-91a6-942ba17ebc79 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:55.003006 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43991bc-fc81-4de2-91a6-942ba17ebc79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:55.004529 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43991bc-fc81-4de2-91a6-942ba17ebc79 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:55.024249 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 426/848] 10.222.0.36 () {56 vars in 1143 bytes} [Sat Oct 8 20:35:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:55.030403 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0978b-644d-43ce-9a28-f61162ed8add None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:55.146805 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0978b-644d-43ce-9a28-f61162ed8add None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:55.180533 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ae744-3682-4896-a868-aa22f489d769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:55.181090 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ae744-3682-4896-a868-aa22f489d769 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.181422 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ae744-3682-4896-a868-aa22f489d769 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.181705 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ae744-3682-4896-a868-aa22f489d769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.192424 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ae744-3682-4896-a868-aa22f489d769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:55.194015 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ae744-3682-4896-a868-aa22f489d769 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-2e6ae744-3682-4896-a868-aa22f489d769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:55.209202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:55.210417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:55.211494 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:55.211494 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:55.211494 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:35:55.211494 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 423/849] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:55.216502 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43991bc-fc81-4de2-91a6-942ba17ebc79 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:55.322128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43991bc-fc81-4de2-91a6-942ba17ebc79 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:55.324991 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:55.362098 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77287d0b-a759-4ea1-8fd4-2f849131adca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:55.362764 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77287d0b-a759-4ea1-8fd4-2f849131adca None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.363086 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77287d0b-a759-4ea1-8fd4-2f849131adca None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.363374 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77287d0b-a759-4ea1-8fd4-2f849131adca None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.364076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77287d0b-a759-4ea1-8fd4-2f849131adca None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:55.364397 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77287d0b-a759-4ea1-8fd4-2f849131adca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:55.365902 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77287d0b-a759-4ea1-8fd4-2f849131adca None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:55.378247 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 427/850] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:55.384326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ae744-3682-4896-a868-aa22f489d769 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:55.387341 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:55.494233 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ae744-3682-4896-a868-aa22f489d769 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:55.532897 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90734588-8271-4a0c-81f7-7218512fe6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:55.533607 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90734588-8271-4a0c-81f7-7218512fe6f2 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.533949 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90734588-8271-4a0c-81f7-7218512fe6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.534225 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90734588-8271-4a0c-81f7-7218512fe6f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.543016 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90734588-8271-4a0c-81f7-7218512fe6f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:55.544593 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90734588-8271-4a0c-81f7-7218512fe6f2 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:55.558161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-90734588-8271-4a0c-81f7-7218512fe6f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:55.558161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:55.558161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:55.558161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:55.558161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:55.558161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:55.558161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:55.558161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:55.558161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:55.558161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:55.558161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:55.558161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:55.558161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:35:55.558161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:35:55.558161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:55.559143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:55.560652 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:35:55.560652 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:35:55.560652 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:35:55.560652 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:35:55.560652 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:35:55.560652 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:35:55.560652 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:35:55.560652 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:35:55.560652 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 424/851] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:35:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:55.566588 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77287d0b-a759-4ea1-8fd4-2f849131adca None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:55.681003 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77287d0b-a759-4ea1-8fd4-2f849131adca None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:55.723958 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040a188-94a5-40ca-a846-cc352d0f6d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:55.724663 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040a188-94a5-40ca-a846-cc352d0f6d6e None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.725002 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040a188-94a5-40ca-a846-cc352d0f6d6e None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.725288 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040a188-94a5-40ca-a846-cc352d0f6d6e None admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.726101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040a188-94a5-40ca-a846-cc352d0f6d6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:55.726436 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040a188-94a5-40ca-a846-cc352d0f6d6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:55.727972 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040a188-94a5-40ca-a846-cc352d0f6d6e None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:55.743008 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 428/852] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:35:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:55.750780 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90734588-8271-4a0c-81f7-7218512fe6f2 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:55.814130 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:55.854776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90734588-8271-4a0c-81f7-7218512fe6f2 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:55.891939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15359604-3b12-4df7-bc91-46b545f75cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:55.894375 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15359604-3b12-4df7-bc91-46b545f75cb2 None admin] REQUEST_METHOD: `PUT` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:55.894629 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15359604-3b12-4df7-bc91-46b545f75cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:55.894974 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15359604-3b12-4df7-bc91-46b545f75cb2 None admin] PATH_INFO: `/v3/projects/bac7915cef1d4e3288a30fd015fcce50/users/9fc15a49c674447d9d85b17eb70c3db3/roles/b849f9edba724fe5a0d7d1e8da249400` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:55.911189 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15359604-3b12-4df7-bc91-46b545f75cb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bac7915cef1d4e3288a30fd015fcce50, user_id=9fc15a49c674447d9d85b17eb70c3db3, role_id=b849f9edba724fe5a0d7d1e8da249400)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:55.912859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15359604-3b12-4df7-bc91-46b545f75cb2 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:55.925795 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 425/853] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:35:55 2022] PUT /identity/v3/projects/bac7915cef1d4e3288a30fd015fcce50/users/9fc15a49c674447d9d85b17eb70c3db3/roles/b849f9edba724fe5a0d7d1e8da249400 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:35:58.684117 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1d6cf-b980-4a2f-a502-90d0c275c648 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:58.684683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1d6cf-b980-4a2f-a502-90d0c275c648 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:58.685132 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1d6cf-b980-4a2f-a502-90d0c275c648 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:58.688280 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 429/854] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:35:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:35:58.693945 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f6f96-7f3e-4509-bde7-fc87f4e9ef8e None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:58.694427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f6f96-7f3e-4509-bde7-fc87f4e9ef8e None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:58.694563 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f6f96-7f3e-4509-bde7-fc87f4e9ef8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:58.713696 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-d14f6f96-7f3e-4509-bde7-fc87f4e9ef8e None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:35:58.714912 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-d14f6f96-7f3e-4509-bde7-fc87f4e9ef8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:35:58.789330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 426/855] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:35:58 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:35:59.115346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1d6cf-b980-4a2f-a502-90d0c275c648 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:59.143580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:59.226335 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1d6cf-b980-4a2f-a502-90d0c275c648 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:59.263734 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4e549-69bb-410b-9cb7-9145893c6e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:59.264493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4e549-69bb-410b-9cb7-9145893c6e9d None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:59.264821 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4e549-69bb-410b-9cb7-9145893c6e9d None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:59.265085 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4e549-69bb-410b-9cb7-9145893c6e9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:59.276545 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4e549-69bb-410b-9cb7-9145893c6e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-40a4e549-69bb-410b-9cb7-9145893c6e9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:35:59.281327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:59.282465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:59.283491 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:59.283491 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:59.283491 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:59.283491 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:59.283491 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:35:59.283491 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:35:59.283491 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:35:59.283491 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:35:59.283491 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:35:59.283491 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:35:59.283491 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 08 20:35:59.283491 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:35:59.283491 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 430/856] 10.222.0.36 () {56 vars in 1102 bytes} [Sat Oct 8 20:35:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:59.288555 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f6f96-7f3e-4509-bde7-fc87f4e9ef8e None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:59.332223 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:59.396497 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f6f96-7f3e-4509-bde7-fc87f4e9ef8e None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:59.437034 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea895a3e-4bf9-473b-a513-d1a2021cfaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:59.437800 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea895a3e-4bf9-473b-a513-d1a2021cfaab None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:59.438164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea895a3e-4bf9-473b-a513-d1a2021cfaab None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:59.438441 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea895a3e-4bf9-473b-a513-d1a2021cfaab None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:59.439220 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea895a3e-4bf9-473b-a513-d1a2021cfaab None admin] RBAC: Adding query filter params (name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:59.439529 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea895a3e-4bf9-473b-a513-d1a2021cfaab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:59.441074 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea895a3e-4bf9-473b-a513-d1a2021cfaab None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:59.450468 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 427/857] 10.222.0.36 () {56 vars in 1103 bytes} [Sat Oct 8 20:35:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:35:59.456746 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4e549-69bb-410b-9cb7-9145893c6e9d None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:59.554076 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:59.571484 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4e549-69bb-410b-9cb7-9145893c6e9d None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:59.610675 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd608a74-f8f9-4db6-881d-8d3e6b8d8ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:59.611330 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd608a74-f8f9-4db6-881d-8d3e6b8d8ecf None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:59.611645 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd608a74-f8f9-4db6-881d-8d3e6b8d8ecf None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:59.611956 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd608a74-f8f9-4db6-881d-8d3e6b8d8ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:59.623110 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd608a74-f8f9-4db6-881d-8d3e6b8d8ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:59.625200 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd608a74-f8f9-4db6-881d-8d3e6b8d8ecf None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-cd608a74-f8f9-4db6-881d-8d3e6b8d8ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:35:59.641658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:35:59.642753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:35:59.648449 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:35:59.648449 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:35:59.648449 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:35:59.648449 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 431/858] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:35:59.649158 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea895a3e-4bf9-473b-a513-d1a2021cfaab None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:59.770622 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea895a3e-4bf9-473b-a513-d1a2021cfaab None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:59.772894 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:59.807251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39e50d-c6bf-49b6-b77c-5b221111da68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:59.807901 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39e50d-c6bf-49b6-b77c-5b221111da68 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:59.808711 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39e50d-c6bf-49b6-b77c-5b221111da68 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:59.808711 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39e50d-c6bf-49b6-b77c-5b221111da68 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:59.809243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39e50d-c6bf-49b6-b77c-5b221111da68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:35:59.809622 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39e50d-c6bf-49b6-b77c-5b221111da68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:59.811121 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39e50d-c6bf-49b6-b77c-5b221111da68 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:35:59.823977 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 428/859] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:35:59.830694 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd608a74-f8f9-4db6-881d-8d3e6b8d8ecf None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:35:59.944070 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd608a74-f8f9-4db6-881d-8d3e6b8d8ecf None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:35:59.984846 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb05540-16a2-467e-9321-c8947fe43ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:35:59.985618 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05540-16a2-467e-9321-c8947fe43ef6 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:35:59.986018 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05540-16a2-467e-9321-c8947fe43ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:35:59.986320 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05540-16a2-467e-9321-c8947fe43ef6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:35:59.989342 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:35:59.995950 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb05540-16a2-467e-9321-c8947fe43ef6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:35:59.997429 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb05540-16a2-467e-9321-c8947fe43ef6 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-deb05540-16a2-467e-9321-c8947fe43ef6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:00.012698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:00.013814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:00.015346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:00.015346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:00.015346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:00.015346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:00.015346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:00.015346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:00.015346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:00.015346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:00.015346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:36:00.015346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:36:00.015346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 432/860] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:35:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:00.020461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39e50d-c6bf-49b6-b77c-5b221111da68 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:00.137870 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39e50d-c6bf-49b6-b77c-5b221111da68 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:00.177100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea707f2-902c-4d5e-a0ff-a3a8726d9ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:00.177786 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea707f2-902c-4d5e-a0ff-a3a8726d9ec6 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:00.178203 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea707f2-902c-4d5e-a0ff-a3a8726d9ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:00.178509 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea707f2-902c-4d5e-a0ff-a3a8726d9ec6 None admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:00.179416 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea707f2-902c-4d5e-a0ff-a3a8726d9ec6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:00.179810 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea707f2-902c-4d5e-a0ff-a3a8726d9ec6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:00.181509 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea707f2-902c-4d5e-a0ff-a3a8726d9ec6 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:00.203284 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 429/861] 10.222.0.36 () {56 vars in 1143 bytes} [Sat Oct 8 20:36:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:00.209326 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb05540-16a2-467e-9321-c8947fe43ef6 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:00.324834 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb05540-16a2-467e-9321-c8947fe43ef6 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:00.362972 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b014e-7117-45a0-8c33-305397db787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:00.363649 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b014e-7117-45a0-8c33-305397db787c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:00.364005 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b014e-7117-45a0-8c33-305397db787c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:00.364416 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b014e-7117-45a0-8c33-305397db787c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:00.434343 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:00.443127 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b014e-7117-45a0-8c33-305397db787c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:00.444582 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b014e-7117-45a0-8c33-305397db787c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:00.550285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 433/862] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:36:00 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:36:00.556104 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea707f2-902c-4d5e-a0ff-a3a8726d9ec6 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:00.581975 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:00.664758 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea707f2-902c-4d5e-a0ff-a3a8726d9ec6 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:00.705121 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c0de2-3457-49b7-b7d5-bfb37c2d9c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:00.705849 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c0de2-3457-49b7-b7d5-bfb37c2d9c08 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:00.706151 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c0de2-3457-49b7-b7d5-bfb37c2d9c08 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:00.706352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c0de2-3457-49b7-b7d5-bfb37c2d9c08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:00.717330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c0de2-3457-49b7-b7d5-bfb37c2d9c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:00.719293 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c0de2-3457-49b7-b7d5-bfb37c2d9c08 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-d87c0de2-3457-49b7-b7d5-bfb37c2d9c08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:00.736846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:00.738243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:00.739582 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:00.739582 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:00.739582 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:00.739582 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 430/863] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:00.744993 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b014e-7117-45a0-8c33-305397db787c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:00.862551 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:00.871498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b014e-7117-45a0-8c33-305397db787c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:00.911623 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538e492-27f3-45cd-841a-4c3cb347e283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:00.912346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538e492-27f3-45cd-841a-4c3cb347e283 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:00.912846 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538e492-27f3-45cd-841a-4c3cb347e283 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:00.913170 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538e492-27f3-45cd-841a-4c3cb347e283 None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:00.914093 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538e492-27f3-45cd-841a-4c3cb347e283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:00.914414 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538e492-27f3-45cd-841a-4c3cb347e283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:00.916072 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538e492-27f3-45cd-841a-4c3cb347e283 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:00.930966 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 434/864] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:00.937298 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c0de2-3457-49b7-b7d5-bfb37c2d9c08 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:01.028698 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:01.060363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c0de2-3457-49b7-b7d5-bfb37c2d9c08 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:01.099665 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d9f4e-cbc5-4501-b9f4-67a251fb9d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:01.100333 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d9f4e-cbc5-4501-b9f4-67a251fb9d05 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:01.100591 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d9f4e-cbc5-4501-b9f4-67a251fb9d05 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:01.100861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d9f4e-cbc5-4501-b9f4-67a251fb9d05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:01.108096 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d9f4e-cbc5-4501-b9f4-67a251fb9d05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:01.109643 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d9f4e-cbc5-4501-b9f4-67a251fb9d05 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:01.122598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-1e1d9f4e-cbc5-4501-b9f4-67a251fb9d05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:01.122598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:01.122598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:01.122598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:01.122598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:01.122598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:01.122598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:01.122598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:01.122598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:01.122598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:01.122598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:01.122598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:01.122598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:01.122598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:01.122598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:01.124134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:01.125352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:01.125352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:01.125352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:01.125352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:01.125352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:01.125352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:01.125352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:01.125352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:01.125352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 431/865] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:01.130405 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538e492-27f3-45cd-841a-4c3cb347e283 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:01.240702 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538e492-27f3-45cd-841a-4c3cb347e283 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:01.278406 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad22e4c-e0d7-4728-b574-333218a9951f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:01.279088 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad22e4c-e0d7-4728-b574-333218a9951f None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:01.279441 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad22e4c-e0d7-4728-b574-333218a9951f None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:01.279758 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad22e4c-e0d7-4728-b574-333218a9951f None admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:01.280467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad22e4c-e0d7-4728-b574-333218a9951f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:01.280768 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad22e4c-e0d7-4728-b574-333218a9951f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:01.282195 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad22e4c-e0d7-4728-b574-333218a9951f None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:01.294788 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 435/866] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:36:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:01.302598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d9f4e-cbc5-4501-b9f4-67a251fb9d05 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:01.414561 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d9f4e-cbc5-4501-b9f4-67a251fb9d05 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:01.448271 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37c3f9-8975-4a21-ba6d-f03cfc854437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:01.448876 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37c3f9-8975-4a21-ba6d-f03cfc854437 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:01.449160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37c3f9-8975-4a21-ba6d-f03cfc854437 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:01.449432 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37c3f9-8975-4a21-ba6d-f03cfc854437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:01.450221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37c3f9-8975-4a21-ba6d-f03cfc854437 None admin] RBAC: Adding query filter params (role.id=b849f9edba724fe5a0d7d1e8da249400, scope.project.id=bac7915cef1d4e3288a30fd015fcce50, user.id=9fc15a49c674447d9d85b17eb70c3db3) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:01.450496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37c3f9-8975-4a21-ba6d-f03cfc854437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:01.452612 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37c3f9-8975-4a21-ba6d-f03cfc854437 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:01.454520 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:01.459223 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 432/867] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:36:01 2022] GET /identity/v3/role_assignments?user.id=9fc15a49c674447d9d85b17eb70c3db3&scope.project.id=bac7915cef1d4e3288a30fd015fcce50&role.id=b849f9edba724fe5a0d7d1e8da249400 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:03.941611 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b7061-95a9-4a54-9c4d-761adde8f928 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:03.942280 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b7061-95a9-4a54-9c4d-761adde8f928 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:03.942280 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b7061-95a9-4a54-9c4d-761adde8f928 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:03.943831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 436/868] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:03.948964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705529e5-0ea1-4139-a640-9118f34d3829 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:03.949394 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705529e5-0ea1-4139-a640-9118f34d3829 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:03.949496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705529e5-0ea1-4139-a640-9118f34d3829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:03.968449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-705529e5-0ea1-4139-a640-9118f34d3829 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:03.969625 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-705529e5-0ea1-4139-a640-9118f34d3829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:04.033186 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 433/869] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:03 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:04.357717 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b7061-95a9-4a54-9c4d-761adde8f928 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:04.375609 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:04.456228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b7061-95a9-4a54-9c4d-761adde8f928 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:04.488846 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227f421-b266-47aa-8be3-ad551bcc081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:04.489452 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227f421-b266-47aa-8be3-ad551bcc081c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:04.489728 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227f421-b266-47aa-8be3-ad551bcc081c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:04.490028 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227f421-b266-47aa-8be3-ad551bcc081c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:04.499812 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227f421-b266-47aa-8be3-ad551bcc081c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-4227f421-b266-47aa-8be3-ad551bcc081c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:04.504492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:04.505657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:04.506808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:04.506808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:04.506808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:04.506808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:04.506808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:04.506808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:04.506808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:04.506808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:04.506808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:04.506808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:04.506808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:04.506808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:36:04.506808 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 437/870] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:36:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:04.511561 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705529e5-0ea1-4139-a640-9118f34d3829 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:04.606602 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705529e5-0ea1-4139-a640-9118f34d3829 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:04.631218 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:04.638848 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1762f-f9c7-4f1e-902a-563ce2e7ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:04.639951 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1762f-f9c7-4f1e-902a-563ce2e7ec64 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:04.640229 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1762f-f9c7-4f1e-902a-563ce2e7ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:04.640500 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1762f-f9c7-4f1e-902a-563ce2e7ec64 None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:04.641149 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1762f-f9c7-4f1e-902a-563ce2e7ec64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:04.641453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1762f-f9c7-4f1e-902a-563ce2e7ec64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:04.642817 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1762f-f9c7-4f1e-902a-563ce2e7ec64 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:04.650468 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 434/871] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:36:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:04.656439 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227f421-b266-47aa-8be3-ad551bcc081c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:04.740940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:04.763002 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227f421-b266-47aa-8be3-ad551bcc081c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:04.796127 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d73552-b920-4a7f-89be-431314c3241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:04.796735 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d73552-b920-4a7f-89be-431314c3241b None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:04.797012 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d73552-b920-4a7f-89be-431314c3241b None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:04.797284 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d73552-b920-4a7f-89be-431314c3241b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:04.806787 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d73552-b920-4a7f-89be-431314c3241b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:04.808193 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d73552-b920-4a7f-89be-431314c3241b None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-32d73552-b920-4a7f-89be-431314c3241b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:04.822203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:04.823310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:04.824464 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:04.824464 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:04.824464 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:36:04.824464 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 438/872] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:04.829682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1762f-f9c7-4f1e-902a-563ce2e7ec64 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:04.927051 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1762f-f9c7-4f1e-902a-563ce2e7ec64 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:04.958085 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ffcf3-4a11-41fa-b5b2-0f190403caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:04.958684 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ffcf3-4a11-41fa-b5b2-0f190403caee None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:04.958968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ffcf3-4a11-41fa-b5b2-0f190403caee None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:04.959242 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ffcf3-4a11-41fa-b5b2-0f190403caee None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:04.959871 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ffcf3-4a11-41fa-b5b2-0f190403caee None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:04.960175 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ffcf3-4a11-41fa-b5b2-0f190403caee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:04.961513 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ffcf3-4a11-41fa-b5b2-0f190403caee None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:04.973547 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 435/873] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:36:04.979196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d73552-b920-4a7f-89be-431314c3241b None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:05.075807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d73552-b920-4a7f-89be-431314c3241b None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:05.101696 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:05.109826 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc39da-fca4-4f1b-a3e1-35fbf40907f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:05.110473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc39da-fca4-4f1b-a3e1-35fbf40907f5 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:05.110750 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc39da-fca4-4f1b-a3e1-35fbf40907f5 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:05.111018 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc39da-fca4-4f1b-a3e1-35fbf40907f5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:05.118142 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc39da-fca4-4f1b-a3e1-35fbf40907f5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:05.119548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc39da-fca4-4f1b-a3e1-35fbf40907f5 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-5bfc39da-fca4-4f1b-a3e1-35fbf40907f5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:05.130286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:05.131407 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:05.132756 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:05.132756 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:05.132756 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:05.132756 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:05.132756 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:05.132756 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:05.132756 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:05.132756 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:05.132756 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:36:05.132756 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:36:05.132756 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 439/874] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:05.137103 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ffcf3-4a11-41fa-b5b2-0f190403caee None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:05.185111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:05.233320 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ffcf3-4a11-41fa-b5b2-0f190403caee None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:05.265257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8a190-b5f8-4f62-ace4-80d849bc5b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:05.265857 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8a190-b5f8-4f62-ace4-80d849bc5b20 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:05.266173 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8a190-b5f8-4f62-ace4-80d849bc5b20 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:05.266452 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8a190-b5f8-4f62-ace4-80d849bc5b20 None admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:05.267170 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8a190-b5f8-4f62-ace4-80d849bc5b20 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:05.267481 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8a190-b5f8-4f62-ace4-80d849bc5b20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:05.268892 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8a190-b5f8-4f62-ace4-80d849bc5b20 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:05.286024 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 436/875] 10.222.0.36 () {56 vars in 1143 bytes} [Sat Oct 8 20:36:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:05.291639 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc39da-fca4-4f1b-a3e1-35fbf40907f5 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:05.387192 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc39da-fca4-4f1b-a3e1-35fbf40907f5 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:05.419332 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b758b94-f899-4293-bbaa-8f159b91497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:05.419919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758b94-f899-4293-bbaa-8f159b91497c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:05.420197 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758b94-f899-4293-bbaa-8f159b91497c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:05.420980 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758b94-f899-4293-bbaa-8f159b91497c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:05.473510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:05.485994 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b758b94-f899-4293-bbaa-8f159b91497c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:05.487415 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b758b94-f899-4293-bbaa-8f159b91497c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:05.581872 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 440/876] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:36:05 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:36:05.587648 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8a190-b5f8-4f62-ace4-80d849bc5b20 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:05.683043 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8a190-b5f8-4f62-ace4-80d849bc5b20 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:05.693395 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:05.721177 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9884a-1338-4f66-9525-2d93131a8a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:05.721941 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9884a-1338-4f66-9525-2d93131a8a91 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:05.722259 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9884a-1338-4f66-9525-2d93131a8a91 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:05.722643 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9884a-1338-4f66-9525-2d93131a8a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:05.733210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9884a-1338-4f66-9525-2d93131a8a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:05.734642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9884a-1338-4f66-9525-2d93131a8a91 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-fdb9884a-1338-4f66-9525-2d93131a8a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:05.749115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:05.750282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:05.751403 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:05.751403 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:05.751403 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:05.751403 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 437/877] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:05.756102 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b758b94-f899-4293-bbaa-8f159b91497c None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:05.839734 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:05.851474 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b758b94-f899-4293-bbaa-8f159b91497c None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:05.885607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8854157-d9b0-4ce9-bc6c-59b1f34bc080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:05.886223 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8854157-d9b0-4ce9-bc6c-59b1f34bc080 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:05.886502 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8854157-d9b0-4ce9-bc6c-59b1f34bc080 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:05.886774 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8854157-d9b0-4ce9-bc6c-59b1f34bc080 None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:05.887400 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8854157-d9b0-4ce9-bc6c-59b1f34bc080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:05.887700 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8854157-d9b0-4ce9-bc6c-59b1f34bc080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:05.889050 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8854157-d9b0-4ce9-bc6c-59b1f34bc080 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:05.899821 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 441/878] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:05.905385 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9884a-1338-4f66-9525-2d93131a8a91 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:06.003492 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9884a-1338-4f66-9525-2d93131a8a91 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:06.035476 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f28fa-315f-4ded-9dd8-ef9fb747b38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:06.036100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f28fa-315f-4ded-9dd8-ef9fb747b38d None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:06.036381 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f28fa-315f-4ded-9dd8-ef9fb747b38d None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:06.036656 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f28fa-315f-4ded-9dd8-ef9fb747b38d None admin] PATH_INFO: `/v3/projects/service` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:06.043079 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f28fa-315f-4ded-9dd8-ef9fb747b38d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:06.044487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f28fa-315f-4ded-9dd8-ef9fb747b38d None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:06.055891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-dd6f28fa-315f-4ded-9dd8-ef9fb747b38d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:06.055891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:06.055891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:06.055891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:06.055891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:06.055891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:06.055891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:06.055891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:06.055891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:06.055891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:06.055891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:06.055891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:06.055891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:06.055891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:06.055891 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:06.056967 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:06.057877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:06.057877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:06.057877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:06.057877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:06.057877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:06.057877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:06.057877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:06.057877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:06.057877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 438/879] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:06.063377 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8854157-d9b0-4ce9-bc6c-59b1f34bc080 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:06.159894 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8854157-d9b0-4ce9-bc6c-59b1f34bc080 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:06.192586 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc091f-83a1-4ac4-bd9b-44cfa0ee20bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:06.193176 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc091f-83a1-4ac4-bd9b-44cfa0ee20bc None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:06.193458 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc091f-83a1-4ac4-bd9b-44cfa0ee20bc None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:06.193732 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc091f-83a1-4ac4-bd9b-44cfa0ee20bc None admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:06.194437 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc091f-83a1-4ac4-bd9b-44cfa0ee20bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:06.194746 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc091f-83a1-4ac4-bd9b-44cfa0ee20bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:06.196157 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc091f-83a1-4ac4-bd9b-44cfa0ee20bc None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:06.207745 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 442/880] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:36:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:06.213823 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f28fa-315f-4ded-9dd8-ef9fb747b38d None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:06.236496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:06.309993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f28fa-315f-4ded-9dd8-ef9fb747b38d None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:06.341192 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5021aa3-5f4b-4edd-a22a-e508a7b0c2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:06.341780 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5021aa3-5f4b-4edd-a22a-e508a7b0c2b7 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:06.342097 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5021aa3-5f4b-4edd-a22a-e508a7b0c2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:06.342880 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5021aa3-5f4b-4edd-a22a-e508a7b0c2b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:06.343592 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5021aa3-5f4b-4edd-a22a-e508a7b0c2b7 None admin] RBAC: Adding query filter params (role.id=323ca657fe7b4b878fd8328ef78f29f4, scope.project.id=bac7915cef1d4e3288a30fd015fcce50, user.id=9fc15a49c674447d9d85b17eb70c3db3) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:06.343901 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5021aa3-5f4b-4edd-a22a-e508a7b0c2b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:06.345305 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5021aa3-5f4b-4edd-a22a-e508a7b0c2b7 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:06.350466 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 439/881] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:36:06 2022] GET /identity/v3/role_assignments?user.id=9fc15a49c674447d9d85b17eb70c3db3&scope.project.id=bac7915cef1d4e3288a30fd015fcce50&role.id=323ca657fe7b4b878fd8328ef78f29f4 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:08.729580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77f07b-4991-4e74-8a20-2470c61cae57 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:08.730541 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77f07b-4991-4e74-8a20-2470c61cae57 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:08.730541 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77f07b-4991-4e74-8a20-2470c61cae57 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:08.731809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 443/882] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:08.738373 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ba704-a75e-4feb-8465-0e52b8ce0a95 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:08.738808 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ba704-a75e-4feb-8465-0e52b8ce0a95 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:08.738957 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ba704-a75e-4feb-8465-0e52b8ce0a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:08.759974 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-436ba704-a75e-4feb-8465-0e52b8ce0a95 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:08.761700 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-436ba704-a75e-4feb-8465-0e52b8ce0a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:08.828144 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 440/883] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:08 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:09.146891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77f07b-4991-4e74-8a20-2470c61cae57 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:09.157677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:09.246702 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77f07b-4991-4e74-8a20-2470c61cae57 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:09.279330 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fc5f6-713e-4564-900f-4ec5f9665532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:09.280632 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fc5f6-713e-4564-900f-4ec5f9665532 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:09.280910 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fc5f6-713e-4564-900f-4ec5f9665532 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:09.281183 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fc5f6-713e-4564-900f-4ec5f9665532 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:09.290946 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fc5f6-713e-4564-900f-4ec5f9665532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-776fc5f6-713e-4564-900f-4ec5f9665532 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:09.296219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:09.297314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:09.298324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:09.298324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:09.298324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:09.298324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:09.298324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:09.298324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:09.298324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:09.298324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:09.298324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:09.298324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:09.298324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:09.298324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:36:09.298324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 444/884] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:36:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:09.303476 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ba704-a75e-4feb-8465-0e52b8ce0a95 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:09.318136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:09.397602 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ba704-a75e-4feb-8465-0e52b8ce0a95 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:09.429719 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b4d08-5a14-4f05-a561-8fda6936109a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:09.430334 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b4d08-5a14-4f05-a561-8fda6936109a None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:09.430612 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b4d08-5a14-4f05-a561-8fda6936109a None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:09.430882 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b4d08-5a14-4f05-a561-8fda6936109a None admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:09.431520 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b4d08-5a14-4f05-a561-8fda6936109a None admin] RBAC: Adding query filter params (name=admin) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:09.431817 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b4d08-5a14-4f05-a561-8fda6936109a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:09.433150 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b4d08-5a14-4f05-a561-8fda6936109a None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:09.440792 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 441/885] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:36:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:09.446369 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fc5f6-713e-4564-900f-4ec5f9665532 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:09.511604 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:09.543890 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fc5f6-713e-4564-900f-4ec5f9665532 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:09.577291 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27247f-e9f4-43d6-abe7-5083c24114c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:09.578008 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27247f-e9f4-43d6-abe7-5083c24114c3 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:09.578290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27247f-e9f4-43d6-abe7-5083c24114c3 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:09.578567 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27247f-e9f4-43d6-abe7-5083c24114c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:09.588068 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27247f-e9f4-43d6-abe7-5083c24114c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:09.589488 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27247f-e9f4-43d6-abe7-5083c24114c3 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-8f27247f-e9f4-43d6-abe7-5083c24114c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:09.603479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:09.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:09.605568 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:09.605568 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:09.605568 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:36:09.605568 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 445/886] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:09.611030 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b4d08-5a14-4f05-a561-8fda6936109a None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:09.684476 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:09.712518 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b4d08-5a14-4f05-a561-8fda6936109a None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:09.746179 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31094bb-6627-4840-9299-457a33c0909c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:09.746786 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31094bb-6627-4840-9299-457a33c0909c None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:09.747054 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31094bb-6627-4840-9299-457a33c0909c None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:09.747332 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31094bb-6627-4840-9299-457a33c0909c None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:09.747964 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31094bb-6627-4840-9299-457a33c0909c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:09.748270 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31094bb-6627-4840-9299-457a33c0909c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:09.750246 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31094bb-6627-4840-9299-457a33c0909c None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:09.761357 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 442/887] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:09.767168 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27247f-e9f4-43d6-abe7-5083c24114c3 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:09.864006 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27247f-e9f4-43d6-abe7-5083c24114c3 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:09.882527 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:09.896658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280407b6-8161-4e61-a3ff-5cf8e6beddf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:09.897276 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280407b6-8161-4e61-a3ff-5cf8e6beddf8 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:09.897552 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280407b6-8161-4e61-a3ff-5cf8e6beddf8 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:09.897823 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280407b6-8161-4e61-a3ff-5cf8e6beddf8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:09.905946 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280407b6-8161-4e61-a3ff-5cf8e6beddf8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:09.907361 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280407b6-8161-4e61-a3ff-5cf8e6beddf8 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-280407b6-8161-4e61-a3ff-5cf8e6beddf8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:09.918156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:09.919290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:09.921167 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:09.921167 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:09.921167 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:09.921167 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:09.921167 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:09.921167 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:09.921167 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:09.921167 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:09.921167 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:36:09.921167 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:36:09.921167 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 446/888] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:09.925586 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31094bb-6627-4840-9299-457a33c0909c None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:10.021456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31094bb-6627-4840-9299-457a33c0909c None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:10.056503 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fab2b-5668-4bf0-87b7-b5584c277efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:10.057115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fab2b-5668-4bf0-87b7-b5584c277efa None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:10.057395 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fab2b-5668-4bf0-87b7-b5584c277efa None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:10.057665 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fab2b-5668-4bf0-87b7-b5584c277efa None admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:10.058422 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fab2b-5668-4bf0-87b7-b5584c277efa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:10.058727 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fab2b-5668-4bf0-87b7-b5584c277efa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:10.060132 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fab2b-5668-4bf0-87b7-b5584c277efa None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:10.062938 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:10.077374 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 443/889] 10.222.0.36 () {56 vars in 1143 bytes} [Sat Oct 8 20:36:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:10.082948 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280407b6-8161-4e61-a3ff-5cf8e6beddf8 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:10.178807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280407b6-8161-4e61-a3ff-5cf8e6beddf8 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:10.209940 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1b9c4-2e76-428b-ac17-c8626cf58caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:10.210548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1b9c4-2e76-428b-ac17-c8626cf58caf None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:10.210825 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1b9c4-2e76-428b-ac17-c8626cf58caf None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:10.211097 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1b9c4-2e76-428b-ac17-c8626cf58caf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:10.221570 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1b9c4-2e76-428b-ac17-c8626cf58caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:10.223008 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1b9c4-2e76-428b-ac17-c8626cf58caf None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-0eb1b9c4-2e76-428b-ac17-c8626cf58caf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:10.236725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:10.237853 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:10.239142 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:10.239142 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:10.239142 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:36:10.239142 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 447/890] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:10.243330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fab2b-5668-4bf0-87b7-b5584c277efa None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:10.337328 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fab2b-5668-4bf0-87b7-b5584c277efa None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:10.369460 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d44f1-dba0-4930-8c48-4b0f40145169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:10.370080 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d44f1-dba0-4930-8c48-4b0f40145169 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:10.370362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d44f1-dba0-4930-8c48-4b0f40145169 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:10.370635 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d44f1-dba0-4930-8c48-4b0f40145169 None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:10.371257 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d44f1-dba0-4930-8c48-4b0f40145169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:10.371559 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d44f1-dba0-4930-8c48-4b0f40145169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:10.372889 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d44f1-dba0-4930-8c48-4b0f40145169 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:10.384038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 444/891] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:10.389532 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1b9c4-2e76-428b-ac17-c8626cf58caf None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:10.419455 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:10.486433 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1b9c4-2e76-428b-ac17-c8626cf58caf None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:10.518463 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e433290-21f7-47eb-9abd-920205100c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:10.519069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e433290-21f7-47eb-9abd-920205100c9e None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:10.519346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e433290-21f7-47eb-9abd-920205100c9e None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:10.519614 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e433290-21f7-47eb-9abd-920205100c9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:10.525961 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e433290-21f7-47eb-9abd-920205100c9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:10.527368 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e433290-21f7-47eb-9abd-920205100c9e None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:10.538622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-2e433290-21f7-47eb-9abd-920205100c9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:10.538622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:10.538622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:10.538622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:10.538622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:10.538622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:10.538622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:10.538622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:10.538622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:10.538622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:10.538622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:10.538622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:10.538622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:10.538622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:10.538622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:10.539559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:10.540505 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:10.540505 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:10.540505 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:10.540505 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:10.540505 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:10.540505 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:10.540505 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:10.540505 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:36:10.540505 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 448/892] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:10.545380 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d44f1-dba0-4930-8c48-4b0f40145169 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:10.598073 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:10.641241 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d44f1-dba0-4930-8c48-4b0f40145169 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:10.672920 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a244c3b-3f06-46a3-9ec2-ad55a8152b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:10.673502 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a244c3b-3f06-46a3-9ec2-ad55a8152b28 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:10.673778 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a244c3b-3f06-46a3-9ec2-ad55a8152b28 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:10.674075 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a244c3b-3f06-46a3-9ec2-ad55a8152b28 None admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:10.674755 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a244c3b-3f06-46a3-9ec2-ad55a8152b28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:10.675058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a244c3b-3f06-46a3-9ec2-ad55a8152b28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:10.676458 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a244c3b-3f06-46a3-9ec2-ad55a8152b28 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:10.689362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 445/893] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:36:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:10.695827 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e433290-21f7-47eb-9abd-920205100c9e None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:10.788025 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:10.797735 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e433290-21f7-47eb-9abd-920205100c9e None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:10.829863 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78994447-325f-4aed-b344-cf7c427243a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:10.830535 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78994447-325f-4aed-b344-cf7c427243a4 None admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:10.830817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78994447-325f-4aed-b344-cf7c427243a4 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:10.831111 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78994447-325f-4aed-b344-cf7c427243a4 None admin] PATH_INFO: `/v3/projects/bac7915cef1d4e3288a30fd015fcce50/users/9fc15a49c674447d9d85b17eb70c3db3/roles/323ca657fe7b4b878fd8328ef78f29f4` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:10.832945 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78994447-325f-4aed-b344-cf7c427243a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=bac7915cef1d4e3288a30fd015fcce50, user_id=9fc15a49c674447d9d85b17eb70c3db3, role_id=323ca657fe7b4b878fd8328ef78f29f4)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:10.834395 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78994447-325f-4aed-b344-cf7c427243a4 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:10.846963 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 449/894] 10.222.0.36 () {58 vars in 1439 bytes} [Sat Oct 8 20:36:10 2022] PUT /identity/v3/projects/bac7915cef1d4e3288a30fd015fcce50/users/9fc15a49c674447d9d85b17eb70c3db3/roles/323ca657fe7b4b878fd8328ef78f29f4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:36:13.204670 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d00c5b-c24b-4481-97b4-b69c2a84ad37 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:13.205192 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d00c5b-c24b-4481-97b4-b69c2a84ad37 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:13.205192 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d00c5b-c24b-4481-97b4-b69c2a84ad37 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:13.206582 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 446/895] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:13.211664 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4036a-6a14-487e-9076-9307fb4fb8d2 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:13.212092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4036a-6a14-487e-9076-9307fb4fb8d2 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:13.212191 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4036a-6a14-487e-9076-9307fb4fb8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:13.230625 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-8cd4036a-6a14-487e-9076-9307fb4fb8d2 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:13.231781 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-8cd4036a-6a14-487e-9076-9307fb4fb8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:13.295324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 450/896] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:13 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:13.616799 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d00c5b-c24b-4481-97b4-b69c2a84ad37 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:13.725962 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d00c5b-c24b-4481-97b4-b69c2a84ad37 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:13.744856 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:13.768947 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb6d68-5967-472b-ac05-c2a3d23ddd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:13.769571 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb6d68-5967-472b-ac05-c2a3d23ddd4e None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:13.769849 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb6d68-5967-472b-ac05-c2a3d23ddd4e None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:13.770154 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb6d68-5967-472b-ac05-c2a3d23ddd4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:13.780529 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb6d68-5967-472b-ac05-c2a3d23ddd4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-71bb6d68-5967-472b-ac05-c2a3d23ddd4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 08 20:36:13.785314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:13.786445 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:13.787318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:13.787318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:13.787318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:13.787318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:13.787318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 08 20:36:13.787318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 08 20:36:13.787318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 08 20:36:13.787318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 08 20:36:13.787318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 08 20:36:13.787318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 08 20:36:13.787318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 08 20:36:13.787318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:13.787318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 447/897] 10.222.0.36 () {56 vars in 1096 bytes} [Sat Oct 8 20:36:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:13.792415 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4036a-6a14-487e-9076-9307fb4fb8d2 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:13.871777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:13.890390 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4036a-6a14-487e-9076-9307fb4fb8d2 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:13.924024 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63875943-6a4f-44ce-a746-4e6af3e9d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:13.924617 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63875943-6a4f-44ce-a746-4e6af3e9d3c6 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:13.924891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63875943-6a4f-44ce-a746-4e6af3e9d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:13.925154 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63875943-6a4f-44ce-a746-4e6af3e9d3c6 None admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:13.925797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63875943-6a4f-44ce-a746-4e6af3e9d3c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:13.926140 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63875943-6a4f-44ce-a746-4e6af3e9d3c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:13.927478 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63875943-6a4f-44ce-a746-4e6af3e9d3c6 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:13.935414 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 451/898] 10.222.0.36 () {56 vars in 1099 bytes} [Sat Oct 8 20:36:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:13.941189 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb6d68-5967-472b-ac05-c2a3d23ddd4e None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:14.038240 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb6d68-5967-472b-ac05-c2a3d23ddd4e None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.071957 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b0bac-e0f9-46f9-abc6-c84368482858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.072585 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b0bac-e0f9-46f9-abc6-c84368482858 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.072865 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b0bac-e0f9-46f9-abc6-c84368482858 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.073138 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b0bac-e0f9-46f9-abc6-c84368482858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.083164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b0bac-e0f9-46f9-abc6-c84368482858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:14.084575 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b0bac-e0f9-46f9-abc6-c84368482858 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-ac5b0bac-e0f9-46f9-abc6-c84368482858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:14.099255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:14.100393 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:14.101511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:14.101511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:14.101511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:14.101511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 448/899] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:14.106009 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63875943-6a4f-44ce-a746-4e6af3e9d3c6 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:14.200837 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63875943-6a4f-44ce-a746-4e6af3e9d3c6 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.232510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609d051-e214-4aa0-8391-f7b9efd19239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.233864 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609d051-e214-4aa0-8391-f7b9efd19239 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.234165 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609d051-e214-4aa0-8391-f7b9efd19239 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.234435 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609d051-e214-4aa0-8391-f7b9efd19239 None admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.235058 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609d051-e214-4aa0-8391-f7b9efd19239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:14.235356 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609d051-e214-4aa0-8391-f7b9efd19239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:14.236692 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609d051-e214-4aa0-8391-f7b9efd19239 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:14.247820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 452/900] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:14.253993 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b0bac-e0f9-46f9-abc6-c84368482858 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:14.280887 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:14.349930 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b0bac-e0f9-46f9-abc6-c84368482858 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.382481 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5a8af-29f8-4fef-988f-b1a85e6efeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.383099 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5a8af-29f8-4fef-988f-b1a85e6efeb5 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.383380 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5a8af-29f8-4fef-988f-b1a85e6efeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.383652 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5a8af-29f8-4fef-988f-b1a85e6efeb5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.390658 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5a8af-29f8-4fef-988f-b1a85e6efeb5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:14.392064 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5a8af-29f8-4fef-988f-b1a85e6efeb5 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-44d5a8af-29f8-4fef-988f-b1a85e6efeb5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 08 20:36:14.402702 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:14.403785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:14.405199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:14.405199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:14.405199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 08 20:36:14.405199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 08 20:36:14.405199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 08 20:36:14.405199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 08 20:36:14.405199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 08 20:36:14.405199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 08 20:36:14.405199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 08 20:36:14.405199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:14.405199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 449/901] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:14.409591 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609d051-e214-4aa0-8391-f7b9efd19239 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:14.413286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:14.505544 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609d051-e214-4aa0-8391-f7b9efd19239 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.538373 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfad4f-81ff-4108-af8e-81d771556e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.538968 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfad4f-81ff-4108-af8e-81d771556e2a None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.539250 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfad4f-81ff-4108-af8e-81d771556e2a None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.539523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfad4f-81ff-4108-af8e-81d771556e2a None admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.540236 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfad4f-81ff-4108-af8e-81d771556e2a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:14.540542 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfad4f-81ff-4108-af8e-81d771556e2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:14.541977 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfad4f-81ff-4108-af8e-81d771556e2a None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:14.559016 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 453/902] 10.222.0.36 () {56 vars in 1143 bytes} [Sat Oct 8 20:36:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:14.564874 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5a8af-29f8-4fef-988f-b1a85e6efeb5 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:14.646116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:14.660684 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5a8af-29f8-4fef-988f-b1a85e6efeb5 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.693634 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fd5e5-ebe1-42c1-8354-918d366373a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.694251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fd5e5-ebe1-42c1-8354-918d366373a6 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.694531 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fd5e5-ebe1-42c1-8354-918d366373a6 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.694802 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fd5e5-ebe1-42c1-8354-918d366373a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:14.759477 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fd5e5-ebe1-42c1-8354-918d366373a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:14.760860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fd5e5-ebe1-42c1-8354-918d366373a6 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:14.838886 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:14.854161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 450/903] 10.222.0.36 () {58 vars in 1282 bytes} [Sat Oct 8 20:36:14 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 08 20:36:14.861502 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfad4f-81ff-4108-af8e-81d771556e2a None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:14.921008 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:14.958420 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfad4f-81ff-4108-af8e-81d771556e2a None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:14.991502 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d51c8a-f3c5-45a9-9c20-523832fc6634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:14.992121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d51c8a-f3c5-45a9-9c20-523832fc6634 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:14.992403 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d51c8a-f3c5-45a9-9c20-523832fc6634 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:14.992677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d51c8a-f3c5-45a9-9c20-523832fc6634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:15.002335 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d51c8a-f3c5-45a9-9c20-523832fc6634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:15.003751 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d51c8a-f3c5-45a9-9c20-523832fc6634 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-26d51c8a-f3c5-45a9-9c20-523832fc6634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 08 20:36:15.018450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:15.019607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 08 20:36:15.020522 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 08 20:36:15.020522 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 08 20:36:15.020522 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:36:15.020522 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 454/904] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 08 20:36:15.025166 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fd5e5-ebe1-42c1-8354-918d366373a6 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:15.120915 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fd5e5-ebe1-42c1-8354-918d366373a6 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:15.153098 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe940293-b24b-4a7a-86e6-36d0799cdb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:15.153701 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe940293-b24b-4a7a-86e6-36d0799cdb1c None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:15.154015 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe940293-b24b-4a7a-86e6-36d0799cdb1c None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:15.154290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe940293-b24b-4a7a-86e6-36d0799cdb1c None admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:15.155559 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe940293-b24b-4a7a-86e6-36d0799cdb1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:15.155861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe940293-b24b-4a7a-86e6-36d0799cdb1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:15.157201 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe940293-b24b-4a7a-86e6-36d0799cdb1c None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:15.167808 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 451/905] 10.222.0.36 () {56 vars in 1109 bytes} [Sat Oct 8 20:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:15.173464 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d51c8a-f3c5-45a9-9c20-523832fc6634 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:15.270408 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d51c8a-f3c5-45a9-9c20-523832fc6634 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:15.283341 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:15.302659 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f118c-63c1-40fe-bf83-466b2403d8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:15.303278 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f118c-63c1-40fe-bf83-466b2403d8bd None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:15.303558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f118c-63c1-40fe-bf83-466b2403d8bd None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:15.303832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f118c-63c1-40fe-bf83-466b2403d8bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:15.310224 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f118c-63c1-40fe-bf83-466b2403d8bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:15.312148 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f118c-63c1-40fe-bf83-466b2403d8bd None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:15.323856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application [None req-0e9f118c-63c1-40fe-bf83-466b2403d8bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:15.323856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:15.323856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:15.323856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:15.323856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:15.323856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:15.323856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:15.323856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:15.323856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:15.323856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:15.323856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:15.323856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:15.323856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 08 20:36:15.323856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 08 20:36:15.323856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:15.324892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:15.329777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 08 20:36:15.329777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 08 20:36:15.329777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 08 20:36:15.329777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 08 20:36:15.329777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 08 20:36:15.329777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 08 20:36:15.329777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 08 20:36:15.329777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: ERROR keystone.server.flask.application Oct 08 20:36:15.329777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 455/906] 10.222.0.36 () {56 vars in 1111 bytes} [Sat Oct 8 20:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:15.330906 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe940293-b24b-4a7a-86e6-36d0799cdb1c None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:15.376341 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:15.426765 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe940293-b24b-4a7a-86e6-36d0799cdb1c None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:15.457841 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcc4b7-d38f-4171-96ae-b5d3056b103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:15.458453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcc4b7-d38f-4171-96ae-b5d3056b103d None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:15.458732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcc4b7-d38f-4171-96ae-b5d3056b103d None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:15.459001 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcc4b7-d38f-4171-96ae-b5d3056b103d None admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:15.459676 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcc4b7-d38f-4171-96ae-b5d3056b103d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:15.459980 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcc4b7-d38f-4171-96ae-b5d3056b103d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:15.461372 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcc4b7-d38f-4171-96ae-b5d3056b103d None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:15.473145 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 452/907] 10.222.0.36 () {56 vars in 1148 bytes} [Sat Oct 8 20:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:15.479225 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f118c-63c1-40fe-bf83-466b2403d8bd None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:15.575234 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f118c-63c1-40fe-bf83-466b2403d8bd None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:15.608138 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1867a-b101-4381-85c4-ba008b0a2c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:15.608723 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1867a-b101-4381-85c4-ba008b0a2c7c None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:15.609048 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1867a-b101-4381-85c4-ba008b0a2c7c None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:15.609268 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1867a-b101-4381-85c4-ba008b0a2c7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:15.610005 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1867a-b101-4381-85c4-ba008b0a2c7c None admin] RBAC: Adding query filter params (role.id=323ca657fe7b4b878fd8328ef78f29f4, scope.project.id=bac7915cef1d4e3288a30fd015fcce50, user.id=9fc15a49c674447d9d85b17eb70c3db3) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:15.610309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1867a-b101-4381-85c4-ba008b0a2c7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:15.611703 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1867a-b101-4381-85c4-ba008b0a2c7c None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:15.617210 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 456/908] 10.222.0.36 () {56 vars in 1374 bytes} [Sat Oct 8 20:36:15 2022] GET /identity/v3/role_assignments?user.id=9fc15a49c674447d9d85b17eb70c3db3&scope.project.id=bac7915cef1d4e3288a30fd015fcce50&role.id=323ca657fe7b4b878fd8328ef78f29f4 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:18.030002 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3147f-5ab2-4414-87e8-7ec0e6d36ad8 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:18.030558 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3147f-5ab2-4414-87e8-7ec0e6d36ad8 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:18.030558 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3147f-5ab2-4414-87e8-7ec0e6d36ad8 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:18.031851 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 453/909] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:18.036901 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641d1fd-75fe-439b-b2a8-3246686f7ff9 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:18.037314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641d1fd-75fe-439b-b2a8-3246686f7ff9 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:18.037451 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641d1fd-75fe-439b-b2a8-3246686f7ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:18.055775 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-1641d1fd-75fe-439b-b2a8-3246686f7ff9 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:18.056955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-1641d1fd-75fe-439b-b2a8-3246686f7ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:18.085982 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:18.122108 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 457/910] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:18 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:18.440960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3147f-5ab2-4414-87e8-7ec0e6d36ad8 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:18.537983 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3147f-5ab2-4414-87e8-7ec0e6d36ad8 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:18.544985 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:18.570658 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce610d-8d65-411f-9a32-fff82a787b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:18.571274 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce610d-8d65-411f-9a32-fff82a787b2f None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:18.571553 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce610d-8d65-411f-9a32-fff82a787b2f None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:18.571825 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce610d-8d65-411f-9a32-fff82a787b2f None admin] PATH_INFO: `/v3/services/placement` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:18.572396 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce610d-8d65-411f-9a32-fff82a787b2f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:18.573735 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce610d-8d65-411f-9a32-fff82a787b2f None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-7cce610d-8d65-411f-9a32-fff82a787b2f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:18.582296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:18.583487 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:18.584370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:18.584370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:18.584370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:18.584370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:18.584370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:18.584370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:18.584370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:18.584370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:18.584370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:18.584370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:18.584370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:18.584370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:18.584370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:36:18.584370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:18.584370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 454/911] 10.222.0.36 () {56 vars in 1117 bytes} [Sat Oct 8 20:36:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:18.589346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641d1fd-75fe-439b-b2a8-3246686f7ff9 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:18.685219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641d1fd-75fe-439b-b2a8-3246686f7ff9 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:18.724405 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed566d5-1571-4921-b5f5-ea510e4d7f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:18.725007 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed566d5-1571-4921-b5f5-ea510e4d7f53 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:18.725318 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed566d5-1571-4921-b5f5-ea510e4d7f53 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:18.725596 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed566d5-1571-4921-b5f5-ea510e4d7f53 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:18.726256 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed566d5-1571-4921-b5f5-ea510e4d7f53 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:18.726562 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed566d5-1571-4921-b5f5-ea510e4d7f53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:18.727942 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed566d5-1571-4921-b5f5-ea510e4d7f53 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:18.733074 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 458/912] 10.222.0.36 () {56 vars in 1116 bytes} [Sat Oct 8 20:36:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:18.740524 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce610d-8d65-411f-9a32-fff82a787b2f None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:18.841000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce610d-8d65-411f-9a32-fff82a787b2f None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:18.878751 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1760c-eda1-4faa-bba2-e7bf3afb3f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:18.879356 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1760c-eda1-4faa-bba2-e7bf3afb3f81 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:18.879642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1760c-eda1-4faa-bba2-e7bf3afb3f81 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:18.879921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1760c-eda1-4faa-bba2-e7bf3afb3f81 None admin] PATH_INFO: `/v3/services` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:18.880549 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1760c-eda1-4faa-bba2-e7bf3afb3f81 None admin] RBAC: Adding query filter params (type=placement) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:18.880859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1760c-eda1-4faa-bba2-e7bf3afb3f81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:18.882240 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1760c-eda1-4faa-bba2-e7bf3afb3f81 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:18.886481 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 455/913] 10.222.0.36 () {56 vars in 1116 bytes} [Sat Oct 8 20:36:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:21.370363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cf901-18dd-4830-82e5-df0085e3f9a5 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:21.370883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cf901-18dd-4830-82e5-df0085e3f9a5 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:21.370883 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cf901-18dd-4830-82e5-df0085e3f9a5 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:21.372152 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 459/914] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:21.377835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcbef1-8a1a-47d0-ab24-4201d7b97797 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:21.378277 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcbef1-8a1a-47d0-ab24-4201d7b97797 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:21.378410 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcbef1-8a1a-47d0-ab24-4201d7b97797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:21.395918 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-8afcbef1-8a1a-47d0-ab24-4201d7b97797 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:21.397175 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-8afcbef1-8a1a-47d0-ab24-4201d7b97797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:21.422453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:21.460428 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 456/915] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:21 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:21.788024 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cf901-18dd-4830-82e5-df0085e3f9a5 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:21.818841 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:21.887004 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cf901-18dd-4830-82e5-df0085e3f9a5 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:21.919105 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7781c0-5b13-42b3-8532-77c100642212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:21.919694 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7781c0-5b13-42b3-8532-77c100642212 None admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:21.919970 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7781c0-5b13-42b3-8532-77c100642212 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:21.920239 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7781c0-5b13-42b3-8532-77c100642212 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:21.920869 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7781c0-5b13-42b3-8532-77c100642212 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:21.922739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7781c0-5b13-42b3-8532-77c100642212 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:21.936510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 460/916] 10.222.0.36 () {60 vars in 1141 bytes} [Sat Oct 8 20:36:21 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:36:24.313105 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19b8c-fd32-4f87-b052-d5d3ca34f2eb None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:24.313619 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19b8c-fd32-4f87-b052-d5d3ca34f2eb None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:24.313619 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19b8c-fd32-4f87-b052-d5d3ca34f2eb None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:24.314853 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 457/917] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:24.320104 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981d916-fa30-4e0b-b0ef-7d59ef124f14 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:24.320479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981d916-fa30-4e0b-b0ef-7d59ef124f14 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:24.320646 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981d916-fa30-4e0b-b0ef-7d59ef124f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:24.338255 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-9981d916-fa30-4e0b-b0ef-7d59ef124f14 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:24.339408 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-9981d916-fa30-4e0b-b0ef-7d59ef124f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:24.408710 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 461/918] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:24 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 08 20:36:24.731141 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b19b8c-fd32-4f87-b052-d5d3ca34f2eb None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:24.830361 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b19b8c-fd32-4f87-b052-d5d3ca34f2eb None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:24.862575 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9701721-7d84-4430-9cb0-16447f57f93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:24.863192 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9701721-7d84-4430-9cb0-16447f57f93d None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:24.863500 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9701721-7d84-4430-9cb0-16447f57f93d None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:24.863771 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9701721-7d84-4430-9cb0-16447f57f93d None admin] PATH_INFO: `/v3/services/placement` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:24.864341 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9701721-7d84-4430-9cb0-16447f57f93d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:24.865698 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9701721-7d84-4430-9cb0-16447f57f93d None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-c9701721-7d84-4430-9cb0-16447f57f93d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:24.874162 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:24.875869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:24.876814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:24.876814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:24.876814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:24.876814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:24.876814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:24.876814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:24.876814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:24.876814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:24.876814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:24.876814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:24.876814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:24.876814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:24.876814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:36:24.876814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:24.876814 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 458/919] 10.222.0.36 () {56 vars in 1117 bytes} [Sat Oct 8 20:36:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:24.883539 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981d916-fa30-4e0b-b0ef-7d59ef124f14 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:24.902084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:24.979989 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981d916-fa30-4e0b-b0ef-7d59ef124f14 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:25.014026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fe429-2c6c-4b40-a0f5-927bc56fac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:25.014557 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fe429-2c6c-4b40-a0f5-927bc56fac70 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:25.014831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fe429-2c6c-4b40-a0f5-927bc56fac70 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:25.015138 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fe429-2c6c-4b40-a0f5-927bc56fac70 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:25.015828 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fe429-2c6c-4b40-a0f5-927bc56fac70 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:25.016126 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fe429-2c6c-4b40-a0f5-927bc56fac70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:25.017476 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fe429-2c6c-4b40-a0f5-927bc56fac70 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:25.022333 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 462/920] 10.222.0.36 () {56 vars in 1116 bytes} [Sat Oct 8 20:36:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:25.028219 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9701721-7d84-4430-9cb0-16447f57f93d None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:25.057923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:25.128078 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9701721-7d84-4430-9cb0-16447f57f93d None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:25.159749 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d58abb-ccf5-4d13-8656-a0d7d578aaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:25.160351 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d58abb-ccf5-4d13-8656-a0d7d578aaeb None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:25.160631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d58abb-ccf5-4d13-8656-a0d7d578aaeb None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:25.160905 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d58abb-ccf5-4d13-8656-a0d7d578aaeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:25.161593 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d58abb-ccf5-4d13-8656-a0d7d578aaeb None admin] RBAC: Adding query filter params (interface=public, service_id=9bd2ebae264d41c49b1f5501135c16e7, region_id=RegionOne) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:25.161923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d58abb-ccf5-4d13-8656-a0d7d578aaeb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:25.163281 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d58abb-ccf5-4d13-8656-a0d7d578aaeb None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:25.168006 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 459/921] 10.222.0.36 () {56 vars in 1251 bytes} [Sat Oct 8 20:36:25 2022] GET /identity/v3/endpoints?service_id=9bd2ebae264d41c49b1f5501135c16e7&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:25.174113 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fe429-2c6c-4b40-a0f5-927bc56fac70 None admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:25.253178 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:25.270924 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fe429-2c6c-4b40-a0f5-927bc56fac70 None admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:25.303624 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2646753-0a79-4af4-8641-fb71a5a10d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:25.304218 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2646753-0a79-4af4-8641-fb71a5a10d9d None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:25.304495 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2646753-0a79-4af4-8641-fb71a5a10d9d None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:25.304765 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2646753-0a79-4af4-8641-fb71a5a10d9d None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:25.305358 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2646753-0a79-4af4-8641-fb71a5a10d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:25.306730 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2646753-0a79-4af4-8641-fb71a5a10d9d None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:25.313619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 463/922] 10.222.0.36 () {56 vars in 1087 bytes} [Sat Oct 8 20:36:25 2022] GET /identity/v3/services => generated 1962 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:36:27.675454 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7512d-4935-40f7-8601-b2db27d715fb None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:27.675984 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7512d-4935-40f7-8601-b2db27d715fb None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:27.675984 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7512d-4935-40f7-8601-b2db27d715fb None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:27.677315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 460/923] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:36:27.682454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c16e1-8241-4d3b-9c90-ce7a8074dc0d None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:27.682874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c16e1-8241-4d3b-9c90-ce7a8074dc0d None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:27.683027 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c16e1-8241-4d3b-9c90-ce7a8074dc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:27.701066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-ef7c16e1-8241-4d3b-9c90-ce7a8074dc0d None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:36:27.702290 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-ef7c16e1-8241-4d3b-9c90-ce7a8074dc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:36:27.766113 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 464/924] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:36:27 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 08 20:36:28.089169 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7512d-4935-40f7-8601-b2db27d715fb None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:28.176812 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:28.186652 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7512d-4935-40f7-8601-b2db27d715fb None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:28.219867 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba7094-52e7-4528-8bb4-e0672ae1c449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:28.220489 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba7094-52e7-4528-8bb4-e0672ae1c449 None admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:28.220768 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba7094-52e7-4528-8bb4-e0672ae1c449 None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:28.221040 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba7094-52e7-4528-8bb4-e0672ae1c449 None admin] PATH_INFO: `/v3/services/placement` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:28.221609 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba7094-52e7-4528-8bb4-e0672ae1c449 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:28.223066 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba7094-52e7-4528-8bb4-e0672ae1c449 None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application [None req-45ba7094-52e7-4528-8bb4-e0672ae1c449 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 08 20:36:28.231470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 08 20:36:28.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.get_or_create( Oct 08 20:36:28.234136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 08 20:36:28.234136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application with Lock( Oct 08 20:36:28.234136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 08 20:36:28.234136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self._enter() Oct 08 20:36:28.234136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 08 20:36:28.234136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 08 20:36:28.234136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 08 20:36:28.234136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application return self.creator() Oct 08 20:36:28.234136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 08 20:36:28.234136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application created_value = creator( Oct 08 20:36:28.234136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 08 20:36:28.234136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 08 20:36:28.234136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 08 20:36:28.234136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: ERROR keystone.server.flask.application Oct 08 20:36:28.234136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 461/925] 10.222.0.36 () {56 vars in 1117 bytes} [Sat Oct 8 20:36:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 08 20:36:28.238785 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c16e1-8241-4d3b-9c90-ce7a8074dc0d None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:28.310976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:28.334386 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c16e1-8241-4d3b-9c90-ce7a8074dc0d None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:28.366710 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172d925-4907-4d78-a83d-6b95b72fcad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:28.367302 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172d925-4907-4d78-a83d-6b95b72fcad9 None admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:28.367577 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172d925-4907-4d78-a83d-6b95b72fcad9 None admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:28.367845 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172d925-4907-4d78-a83d-6b95b72fcad9 None admin] PATH_INFO: `/v3/services` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:28.368469 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172d925-4907-4d78-a83d-6b95b72fcad9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:36:28.368761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172d925-4907-4d78-a83d-6b95b72fcad9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:28.370123 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172d925-4907-4d78-a83d-6b95b72fcad9 None admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:28.375487 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 465/926] 10.222.0.36 () {56 vars in 1116 bytes} [Sat Oct 8 20:36:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:36:28.381236 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba7094-52e7-4528-8bb4-e0672ae1c449 None admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:36:28.476534 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba7094-52e7-4528-8bb4-e0672ae1c449 None admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:36:28.508439 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a11dc-dce5-4567-b57d-59270aca2a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:36:28.509033 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a11dc-dce5-4567-b57d-59270aca2a3f None admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:36:28.509312 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a11dc-dce5-4567-b57d-59270aca2a3f None admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:36:28.509585 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a11dc-dce5-4567-b57d-59270aca2a3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:36:28.510270 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a11dc-dce5-4567-b57d-59270aca2a3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:36:28.511612 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a11dc-dce5-4567-b57d-59270aca2a3f None admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:36:28.531683 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 462/927] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Oct 8 20:36:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:36:38.372562 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=30 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:36:38.526629 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:28.481698 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f5a07-e0f2-48f8-a470-8fdbde759e60 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:28.482315 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f5a07-e0f2-48f8-a470-8fdbde759e60 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:28.482315 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f5a07-e0f2-48f8-a470-8fdbde759e60 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:28.483907 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 466/928] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:28.490038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73e06c-b66a-4430-bac1-48e5de2e53b3 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:28.490505 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73e06c-b66a-4430-bac1-48e5de2e53b3 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:28.490601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73e06c-b66a-4430-bac1-48e5de2e53b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:28.509913 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-5a73e06c-b66a-4430-bac1-48e5de2e53b3 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:28.511172 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-5a73e06c-b66a-4430-bac1-48e5de2e53b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:28.602558 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 463/929] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:37:28.950565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca44afe-adb1-4edf-bbde-c0f5d20268c9 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:28.950931 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca44afe-adb1-4edf-bbde-c0f5d20268c9 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:28.951269 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca44afe-adb1-4edf-bbde-c0f5d20268c9 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:28.952672 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 467/930] 10.222.0.36 () {54 vars in 964 bytes} [Sat Oct 8 20:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:28.959322 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154b651-d1a8-42b3-a8e6-8903c8844157 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:28.959682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154b651-d1a8-42b3-a8e6-8903c8844157 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:28.960059 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154b651-d1a8-42b3-a8e6-8903c8844157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:29.023670 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-c154b651-d1a8-42b3-a8e6-8903c8844157 None None] MFA Rules not processed for user `98b1f2e36ec948eabeb7c0c1bdf87216`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:29.024909 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-c154b651-d1a8-42b3-a8e6-8903c8844157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:29.093773 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 464/931] 10.222.0.36 () {58 vars in 1061 bytes} [Sat Oct 8 20:37:28 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:37:29.104987 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca44afe-adb1-4edf-bbde-c0f5d20268c9 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:29.116972 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca44afe-adb1-4edf-bbde-c0f5d20268c9 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:29.120455 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5f2f8-7e22-485c-9297-9736ae24137a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:29.121060 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5f2f8-7e22-485c-9297-9736ae24137a service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:29.121339 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5f2f8-7e22-485c-9297-9736ae24137a service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:29.121611 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5f2f8-7e22-485c-9297-9736ae24137a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:29.130913 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5f2f8-7e22-485c-9297-9736ae24137a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:29.132326 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5f2f8-7e22-485c-9297-9736ae24137a service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:29.141644 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 468/932] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:37:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:37:31.807026 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5673c6-9b69-4098-8919-0e7e2f888845 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:31.807573 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5673c6-9b69-4098-8919-0e7e2f888845 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:31.807573 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5673c6-9b69-4098-8919-0e7e2f888845 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:31.808909 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 465/933] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:31.814206 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282270ba-2ee7-49c4-82c3-2e8de42a8ec3 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:31.814665 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282270ba-2ee7-49c4-82c3-2e8de42a8ec3 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:31.814762 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282270ba-2ee7-49c4-82c3-2e8de42a8ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:31.834232 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-282270ba-2ee7-49c4-82c3-2e8de42a8ec3 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:31.835402 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-282270ba-2ee7-49c4-82c3-2e8de42a8ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:31.842900 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 469/934] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:37:32.171578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5673c6-9b69-4098-8919-0e7e2f888845 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:32.182668 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5673c6-9b69-4098-8919-0e7e2f888845 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:32.186122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f474ed-a3e2-408f-8874-7deb2945638a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:32.186717 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f474ed-a3e2-408f-8874-7deb2945638a service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:32.187000 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f474ed-a3e2-408f-8874-7deb2945638a service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:32.187279 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f474ed-a3e2-408f-8874-7deb2945638a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:32.196669 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f474ed-a3e2-408f-8874-7deb2945638a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:32.198135 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f474ed-a3e2-408f-8874-7deb2945638a service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:32.207910 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 466/935] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:37:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:37:34.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f75f18-666e-4215-8fb4-bb5a3b70fd59 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:34.942105 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f75f18-666e-4215-8fb4-bb5a3b70fd59 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:34.942185 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f75f18-666e-4215-8fb4-bb5a3b70fd59 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:34.943637 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 470/936] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:34.948692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf68cc-7466-4baa-b964-7a75c183630b None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:34.949091 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf68cc-7466-4baa-b964-7a75c183630b None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:34.949271 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf68cc-7466-4baa-b964-7a75c183630b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:34.988744 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-0fcf68cc-7466-4baa-b964-7a75c183630b None None] MFA Rules not processed for user `0b29cea55e144cb6a1feea5fe876a199`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:34.990090 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-0fcf68cc-7466-4baa-b964-7a75c183630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:35.034680 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:37:35.072142 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 467/937] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:34 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:37:35.425488 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f75f18-666e-4215-8fb4-bb5a3b70fd59 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:35.436266 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f75f18-666e-4215-8fb4-bb5a3b70fd59 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:35.440462 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591571a3-57f3-4c4a-852f-62a783362307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:35.441040 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591571a3-57f3-4c4a-852f-62a783362307 service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:35.441316 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591571a3-57f3-4c4a-852f-62a783362307 service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:35.441585 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591571a3-57f3-4c4a-852f-62a783362307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:35.450431 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591571a3-57f3-4c4a-852f-62a783362307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:35.451835 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591571a3-57f3-4c4a-852f-62a783362307 service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:35.461476 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 471/938] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:37:35 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:37:38.408862 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2abf11-0b87-4ef9-a4b6-fc05d4534133 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:38.409409 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2abf11-0b87-4ef9-a4b6-fc05d4534133 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:38.409409 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2abf11-0b87-4ef9-a4b6-fc05d4534133 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:38.410705 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 468/939] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:38.415888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12886a83-c200-4095-a036-6f8106371d5a None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:38.416329 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12886a83-c200-4095-a036-6f8106371d5a None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:38.416428 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12886a83-c200-4095-a036-6f8106371d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:38.434968 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-12886a83-c200-4095-a036-6f8106371d5a None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:38.436133 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-12886a83-c200-4095-a036-6f8106371d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:38.500643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 472/940] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:38 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:37:38.861131 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413e5cc-5053-4a5f-8854-a8ce27875b45 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:38.861417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413e5cc-5053-4a5f-8854-a8ce27875b45 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:38.861689 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413e5cc-5053-4a5f-8854-a8ce27875b45 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:38.863028 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 469/941] 10.222.0.36 () {54 vars in 964 bytes} [Sat Oct 8 20:37:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:38.868897 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b1a08-e6cf-4287-a4ef-965a7e8f3177 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:38.869184 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b1a08-e6cf-4287-a4ef-965a7e8f3177 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:38.869458 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b1a08-e6cf-4287-a4ef-965a7e8f3177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:38.888439 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-c84b1a08-e6cf-4287-a4ef-965a7e8f3177 None None] MFA Rules not processed for user `98b1f2e36ec948eabeb7c0c1bdf87216`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:38.889627 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-c84b1a08-e6cf-4287-a4ef-965a7e8f3177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:38.895862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 473/942] 10.222.0.36 () {58 vars in 1061 bytes} [Sat Oct 8 20:37:38 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:37:38.904384 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413e5cc-5053-4a5f-8854-a8ce27875b45 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:38.915320 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413e5cc-5053-4a5f-8854-a8ce27875b45 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:38.918723 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaa54f-7b9b-4712-abca-18f5c517bd61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:38.919311 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaa54f-7b9b-4712-abca-18f5c517bd61 service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:38.919593 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaa54f-7b9b-4712-abca-18f5c517bd61 service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:38.919865 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaa54f-7b9b-4712-abca-18f5c517bd61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:38.928908 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaaa54f-7b9b-4712-abca-18f5c517bd61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:38.930363 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaaa54f-7b9b-4712-abca-18f5c517bd61 service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:38.939326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 470/943] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:37:38 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:37:42.436552 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d288f82-cecd-4da1-9a02-dc70e15ea780 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:42.437067 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d288f82-cecd-4da1-9a02-dc70e15ea780 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:42.437067 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d288f82-cecd-4da1-9a02-dc70e15ea780 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:42.438667 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 474/944] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:42.443657 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84cafd-b2fe-4081-996a-48f75149f5b7 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:42.444061 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84cafd-b2fe-4081-996a-48f75149f5b7 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:42.444206 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84cafd-b2fe-4081-996a-48f75149f5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:42.463597 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-2c84cafd-b2fe-4081-996a-48f75149f5b7 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:42.464779 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-2c84cafd-b2fe-4081-996a-48f75149f5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:42.473386 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 471/945] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:37:42.813396 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d288f82-cecd-4da1-9a02-dc70e15ea780 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:42.823900 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d288f82-cecd-4da1-9a02-dc70e15ea780 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:42.827364 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5175d13-e37d-42ba-aa3e-d3b139677f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:42.827950 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5175d13-e37d-42ba-aa3e-d3b139677f8f service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:42.828802 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5175d13-e37d-42ba-aa3e-d3b139677f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:42.829075 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5175d13-e37d-42ba-aa3e-d3b139677f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:42.838141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5175d13-e37d-42ba-aa3e-d3b139677f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:42.839553 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5175d13-e37d-42ba-aa3e-d3b139677f8f service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:42.849817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 475/946] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:37:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:37:45.311830 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39c393-4e22-44fa-bf7e-711a0fd8ff8f None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:45.312346 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39c393-4e22-44fa-bf7e-711a0fd8ff8f None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:45.312346 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39c393-4e22-44fa-bf7e-711a0fd8ff8f None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:45.313973 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 472/947] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:45.318962 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfd867-b39b-4c4f-9f4f-a2298a4f324c None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:45.319361 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfd867-b39b-4c4f-9f4f-a2298a4f324c None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:45.319630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfd867-b39b-4c4f-9f4f-a2298a4f324c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:45.339205 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-29cfd867-b39b-4c4f-9f4f-a2298a4f324c None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:45.340492 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-29cfd867-b39b-4c4f-9f4f-a2298a4f324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:45.348803 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 476/948] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:37:45.689818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39c393-4e22-44fa-bf7e-711a0fd8ff8f None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:45.700752 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39c393-4e22-44fa-bf7e-711a0fd8ff8f None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:45.704471 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c893850-7168-4ef0-9a11-d01f63fbe2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:45.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c893850-7168-4ef0-9a11-d01f63fbe2fa service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:45.705353 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c893850-7168-4ef0-9a11-d01f63fbe2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:45.705621 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c893850-7168-4ef0-9a11-d01f63fbe2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:45.715248 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c893850-7168-4ef0-9a11-d01f63fbe2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:45.716660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c893850-7168-4ef0-9a11-d01f63fbe2fa service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:45.726577 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 473/949] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:37:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:37:48.166220 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69015c5f-8589-40c4-b6b5-ba7d412e9714 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:48.166765 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69015c5f-8589-40c4-b6b5-ba7d412e9714 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:48.166862 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69015c5f-8589-40c4-b6b5-ba7d412e9714 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:48.168230 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 477/950] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:48.174010 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172e37c-d243-4ee8-b8a7-19cec5e00ab6 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:48.174424 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172e37c-d243-4ee8-b8a7-19cec5e00ab6 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:48.174560 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172e37c-d243-4ee8-b8a7-19cec5e00ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:48.194054 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-b172e37c-d243-4ee8-b8a7-19cec5e00ab6 None None] MFA Rules not processed for user `0b29cea55e144cb6a1feea5fe876a199`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:48.195230 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-b172e37c-d243-4ee8-b8a7-19cec5e00ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:48.203005 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 474/951] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:48 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:37:48.536803 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69015c5f-8589-40c4-b6b5-ba7d412e9714 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:48.547457 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69015c5f-8589-40c4-b6b5-ba7d412e9714 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:48.550881 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e8942-24f5-4299-8245-660e288c098b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:48.551464 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e8942-24f5-4299-8245-660e288c098b service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:48.551741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e8942-24f5-4299-8245-660e288c098b service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:48.552009 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e8942-24f5-4299-8245-660e288c098b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:48.560602 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e8942-24f5-4299-8245-660e288c098b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:48.562049 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e8942-24f5-4299-8245-660e288c098b service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:48.572250 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 478/952] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:37:48 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:37:51.181562 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49a72c-ce7e-43a8-b178-87b242d55249 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:51.182378 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49a72c-ce7e-43a8-b178-87b242d55249 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:51.182651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49a72c-ce7e-43a8-b178-87b242d55249 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:51.183992 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 475/953] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:51.190510 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4dac9-6edb-400e-b9fe-7f6a5740ae54 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:51.190978 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4dac9-6edb-400e-b9fe-7f6a5740ae54 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:51.190978 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4dac9-6edb-400e-b9fe-7f6a5740ae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:51.215991 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-7be4dac9-6edb-400e-b9fe-7f6a5740ae54 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:51.217181 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-7be4dac9-6edb-400e-b9fe-7f6a5740ae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:51.225094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 479/954] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:37:51.558315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49a72c-ce7e-43a8-b178-87b242d55249 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:51.569502 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49a72c-ce7e-43a8-b178-87b242d55249 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:51.572968 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e7ae0-196a-4b4e-a1bd-b9fae4d921a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:51.573549 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e7ae0-196a-4b4e-a1bd-b9fae4d921a4 service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:51.573823 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e7ae0-196a-4b4e-a1bd-b9fae4d921a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:51.574122 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e7ae0-196a-4b4e-a1bd-b9fae4d921a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:51.584190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e7ae0-196a-4b4e-a1bd-b9fae4d921a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:51.585604 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e7ae0-196a-4b4e-a1bd-b9fae4d921a4 service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:51.595243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 476/955] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:37:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:37:54.069592 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06720d8-e7ac-4aae-8651-272857ac5500 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:54.070058 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06720d8-e7ac-4aae-8651-272857ac5500 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:54.070171 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06720d8-e7ac-4aae-8651-272857ac5500 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:54.071438 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 480/956] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:54.076556 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240422b2-1afb-430a-b4df-abbb677840f5 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:54.076927 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240422b2-1afb-430a-b4df-abbb677840f5 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:54.077102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240422b2-1afb-430a-b4df-abbb677840f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:54.096126 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-240422b2-1afb-430a-b4df-abbb677840f5 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:54.097282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-240422b2-1afb-430a-b4df-abbb677840f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:54.104845 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 477/957] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:37:54.438647 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06720d8-e7ac-4aae-8651-272857ac5500 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:54.449000 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06720d8-e7ac-4aae-8651-272857ac5500 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:54.452362 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88903142-5779-4e17-a60f-8ed4215fceb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:54.453488 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88903142-5779-4e17-a60f-8ed4215fceb8 service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:54.453786 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88903142-5779-4e17-a60f-8ed4215fceb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:54.454148 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88903142-5779-4e17-a60f-8ed4215fceb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:54.462619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88903142-5779-4e17-a60f-8ed4215fceb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:54.464004 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88903142-5779-4e17-a60f-8ed4215fceb8 service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:54.473694 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 481/958] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:37:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:37:57.176857 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd52bd-1dbc-4f04-a565-16c0bc22848e None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:57.177352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd52bd-1dbc-4f04-a565-16c0bc22848e None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:57.177352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd52bd-1dbc-4f04-a565-16c0bc22848e None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:57.178674 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 478/959] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:37:57.183709 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653f732-a176-4d64-b0f7-240aac5c88ff None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:57.184128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653f732-a176-4d64-b0f7-240aac5c88ff None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:57.184281 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653f732-a176-4d64-b0f7-240aac5c88ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:57.203866 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-0653f732-a176-4d64-b0f7-240aac5c88ff None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:37:57.205036 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-0653f732-a176-4d64-b0f7-240aac5c88ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:37:57.212468 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 482/960] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:37:57 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:37:57.548172 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd52bd-1dbc-4f04-a565-16c0bc22848e None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:37:57.558536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd52bd-1dbc-4f04-a565-16c0bc22848e None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:37:57.561969 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514738d2-d247-4748-b30f-91e1bd7b7549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:37:57.563138 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514738d2-d247-4748-b30f-91e1bd7b7549 service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:37:57.563485 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514738d2-d247-4748-b30f-91e1bd7b7549 service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:37:57.563761 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514738d2-d247-4748-b30f-91e1bd7b7549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:37:57.572207 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514738d2-d247-4748-b30f-91e1bd7b7549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:37:57.573611 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514738d2-d247-4748-b30f-91e1bd7b7549 service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:37:57.583460 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 479/961] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:37:57 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:01.944445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a273fc-c517-48d2-b0ac-c985bed5795e None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:01.944953 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a273fc-c517-48d2-b0ac-c985bed5795e None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:01.944953 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a273fc-c517-48d2-b0ac-c985bed5795e None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:01.946268 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 483/962] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:01.951600 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2bbe2-8ddf-4023-904c-ca854ac26deb None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:01.952007 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2bbe2-8ddf-4023-904c-ca854ac26deb None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:01.952265 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2bbe2-8ddf-4023-904c-ca854ac26deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:01.971584 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-90c2bbe2-8ddf-4023-904c-ca854ac26deb None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:01.972741 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-90c2bbe2-8ddf-4023-904c-ca854ac26deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:01.980345 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 480/963] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:02.316758 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a273fc-c517-48d2-b0ac-c985bed5795e None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:02.322007 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=77 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:02.328623 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a273fc-c517-48d2-b0ac-c985bed5795e None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:02.332081 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50f652-e0de-4419-b86f-a5f23789d070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:02.332669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50f652-e0de-4419-b86f-a5f23789d070 service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:02.332942 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50f652-e0de-4419-b86f-a5f23789d070 service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:02.333206 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50f652-e0de-4419-b86f-a5f23789d070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:02.341878 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50f652-e0de-4419-b86f-a5f23789d070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:02.343297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50f652-e0de-4419-b86f-a5f23789d070 service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:02.352623 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 484/964] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:05.383019 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe73735-e753-420f-8ec8-8a3a159b2a55 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:05.383529 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe73735-e753-420f-8ec8-8a3a159b2a55 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:05.383529 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe73735-e753-420f-8ec8-8a3a159b2a55 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:05.384795 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 481/965] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:05.389807 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf3f77-ad93-4bd9-8bea-fb582adc82ec None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:05.390859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf3f77-ad93-4bd9-8bea-fb582adc82ec None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:05.391210 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf3f77-ad93-4bd9-8bea-fb582adc82ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:05.410182 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-0acf3f77-ad93-4bd9-8bea-fb582adc82ec None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:05.411358 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-0acf3f77-ad93-4bd9-8bea-fb582adc82ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:05.418921 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 485/966] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:05 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:05.755014 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe73735-e753-420f-8ec8-8a3a159b2a55 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:05.760248 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=48 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:05.767104 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe73735-e753-420f-8ec8-8a3a159b2a55 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:05.770584 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdfcfc-e0b8-44ad-8231-ece2e3774004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:05.771176 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdfcfc-e0b8-44ad-8231-ece2e3774004 service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:05.771449 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdfcfc-e0b8-44ad-8231-ece2e3774004 service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:05.771716 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdfcfc-e0b8-44ad-8231-ece2e3774004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:05.780645 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdfcfc-e0b8-44ad-8231-ece2e3774004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:05.782710 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdfcfc-e0b8-44ad-8231-ece2e3774004 service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:05.791821 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 482/967] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:05 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:10.337948 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a7d1a-b62c-4d9e-852d-0f3f223a9954 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:10.338508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a7d1a-b62c-4d9e-852d-0f3f223a9954 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:10.338508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a7d1a-b62c-4d9e-852d-0f3f223a9954 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:10.339729 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 486/968] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:10.345685 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7254d-b2bd-4a85-93ba-9aeef1456eb6 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:10.346164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7254d-b2bd-4a85-93ba-9aeef1456eb6 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:10.346266 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7254d-b2bd-4a85-93ba-9aeef1456eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:10.365992 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-44b7254d-b2bd-4a85-93ba-9aeef1456eb6 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:10.367168 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-44b7254d-b2bd-4a85-93ba-9aeef1456eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:10.375320 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 483/969] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:10.712458 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a7d1a-b62c-4d9e-852d-0f3f223a9954 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:10.724244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a7d1a-b62c-4d9e-852d-0f3f223a9954 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:10.727838 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb41494-b2be-4bf0-939a-cb6942139e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:10.728456 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb41494-b2be-4bf0-939a-cb6942139e38 service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:10.728730 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb41494-b2be-4bf0-939a-cb6942139e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:10.728997 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb41494-b2be-4bf0-939a-cb6942139e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:10.738629 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb41494-b2be-4bf0-939a-cb6942139e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:10.740062 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb41494-b2be-4bf0-939a-cb6942139e38 service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:10.750688 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 487/970] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:16.217752 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4725e-1a55-4926-a302-56b50be584eb None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:16.218346 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4725e-1a55-4926-a302-56b50be584eb None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:16.218536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4725e-1a55-4926-a302-56b50be584eb None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:16.219707 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 484/971] 10.222.0.36 () {54 vars in 921 bytes} [Sat Oct 8 20:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:16.224986 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb8cd5-027a-4a13-9265-5a6fb723c52b None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:16.225822 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb8cd5-027a-4a13-9265-5a6fb723c52b None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:16.226345 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb8cd5-027a-4a13-9265-5a6fb723c52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:16.265668 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-ecbb8cd5-027a-4a13-9265-5a6fb723c52b None None] MFA Rules not processed for user `9fc15a49c674447d9d85b17eb70c3db3`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:16.267548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-ecbb8cd5-027a-4a13-9265-5a6fb723c52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:16.371654 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 488/972] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Oct 8 20:38:16 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:20.361159 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=8 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:21.050213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862c80f-728c-4d79-8134-a8c8aea40355 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:21.052544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862c80f-728c-4d79-8134-a8c8aea40355 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:21.052544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862c80f-728c-4d79-8134-a8c8aea40355 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:21.052544 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 485/973] 10.222.0.36 () {54 vars in 921 bytes} [Sat Oct 8 20:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:21.062621 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378c48b-8d1b-4991-94fb-59d8bbc63f38 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:21.065716 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378c48b-8d1b-4991-94fb-59d8bbc63f38 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:21.066397 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378c48b-8d1b-4991-94fb-59d8bbc63f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:21.087841 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-9378c48b-8d1b-4991-94fb-59d8bbc63f38 None None] MFA Rules not processed for user `9fc15a49c674447d9d85b17eb70c3db3`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:21.089307 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-9378c48b-8d1b-4991-94fb-59d8bbc63f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:21.099332 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 489/974] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Oct 8 20:38:21 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:22.501086 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d82f4-a38c-496f-bf73-2e6d708fd21a None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:22.501629 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d82f4-a38c-496f-bf73-2e6d708fd21a None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:22.501629 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d82f4-a38c-496f-bf73-2e6d708fd21a None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:22.503120 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 486/975] 10.222.0.36 () {54 vars in 921 bytes} [Sat Oct 8 20:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:22.508193 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77607bbe-1636-4f47-a311-75cb71fe7817 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:22.508622 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77607bbe-1636-4f47-a311-75cb71fe7817 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:22.508872 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77607bbe-1636-4f47-a311-75cb71fe7817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:22.528623 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-77607bbe-1636-4f47-a311-75cb71fe7817 None None] MFA Rules not processed for user `9fc15a49c674447d9d85b17eb70c3db3`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:22.529989 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-77607bbe-1636-4f47-a311-75cb71fe7817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:22.539799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 490/976] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Oct 8 20:38:22 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:38:26.589421 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8870c70-4fcd-41d1-8aaf-9b08136205a5 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:26.590051 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8870c70-4fcd-41d1-8aaf-9b08136205a5 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:26.590051 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8870c70-4fcd-41d1-8aaf-9b08136205a5 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:26.591629 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 487/977] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:26.597313 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab5374-1cab-4b09-bfb7-f098405d421b None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:26.598187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab5374-1cab-4b09-bfb7-f098405d421b None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:26.598677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab5374-1cab-4b09-bfb7-f098405d421b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:26.620199 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-36ab5374-1cab-4b09-bfb7-f098405d421b None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:26.621730 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-36ab5374-1cab-4b09-bfb7-f098405d421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:26.630223 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 491/978] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:26.983290 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67ac64-e689-4e88-b292-49cd0e4965d4 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:26.984138 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67ac64-e689-4e88-b292-49cd0e4965d4 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:26.984816 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67ac64-e689-4e88-b292-49cd0e4965d4 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:26.986644 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 488/979] 10.222.0.36 () {54 vars in 961 bytes} [Sat Oct 8 20:38:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:26.995260 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a4f0a-93fa-44f7-ab4a-0708f69bc24f None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:26.995841 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a4f0a-93fa-44f7-ab4a-0708f69bc24f None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:26.996325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a4f0a-93fa-44f7-ab4a-0708f69bc24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:27.039619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-9c8a4f0a-93fa-44f7-ab4a-0708f69bc24f None None] MFA Rules not processed for user `017db52cc36f4bdb9448afe74edab753`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:27.040817 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-9c8a4f0a-93fa-44f7-ab4a-0708f69bc24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:27.118661 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:27.123902 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 492/980] 10.222.0.36 () {58 vars in 1058 bytes} [Sat Oct 8 20:38:26 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:38:27.131486 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67ac64-e689-4e88-b292-49cd0e4965d4 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:27.146880 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67ac64-e689-4e88-b292-49cd0e4965d4 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:27.151779 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf1568-6525-4e4f-b90a-92f52fc9afac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:27.152384 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf1568-6525-4e4f-b90a-92f52fc9afac service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:27.152665 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf1568-6525-4e4f-b90a-92f52fc9afac service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:27.152938 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf1568-6525-4e4f-b90a-92f52fc9afac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:27.163109 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf1568-6525-4e4f-b90a-92f52fc9afac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:27.164763 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf1568-6525-4e4f-b90a-92f52fc9afac service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:27.175948 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 489/981] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:29.801067 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3ee68-a297-4fc2-8f89-10eee32250da None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:29.801587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3ee68-a297-4fc2-8f89-10eee32250da None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:29.801587 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3ee68-a297-4fc2-8f89-10eee32250da None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:29.802893 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 493/982] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:29.808031 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f294aa4-c524-4e85-ba46-66cd5fb3e0ca None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:29.808472 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f294aa4-c524-4e85-ba46-66cd5fb3e0ca None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:29.808575 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f294aa4-c524-4e85-ba46-66cd5fb3e0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:29.829246 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-5f294aa4-c524-4e85-ba46-66cd5fb3e0ca None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:29.830613 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-5f294aa4-c524-4e85-ba46-66cd5fb3e0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:29.838697 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 490/983] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:30.181150 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3ee68-a297-4fc2-8f89-10eee32250da None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:30.195561 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3ee68-a297-4fc2-8f89-10eee32250da None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:30.200989 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0ae66-d9dc-411c-a3a0-73a1f5e1549a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:30.201756 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0ae66-d9dc-411c-a3a0-73a1f5e1549a service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:30.202304 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0ae66-d9dc-411c-a3a0-73a1f5e1549a service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:30.202732 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0ae66-d9dc-411c-a3a0-73a1f5e1549a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:30.211958 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0ae66-d9dc-411c-a3a0-73a1f5e1549a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:30.213515 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0ae66-d9dc-411c-a3a0-73a1f5e1549a service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:30.224347 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 494/984] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:32.979046 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b99d9f-03ed-4c1c-bd08-59bef85ed398 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:32.979523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b99d9f-03ed-4c1c-bd08-59bef85ed398 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:32.979638 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b99d9f-03ed-4c1c-bd08-59bef85ed398 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:32.980915 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 491/985] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:32.987947 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870cf04-0dc8-4574-bed8-bcdbea90d502 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:32.987947 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870cf04-0dc8-4574-bed8-bcdbea90d502 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:32.988393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870cf04-0dc8-4574-bed8-bcdbea90d502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:33.009376 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-2870cf04-0dc8-4574-bed8-bcdbea90d502 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:33.010709 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-2870cf04-0dc8-4574-bed8-bcdbea90d502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:33.019411 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 495/986] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:33.371353 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c185ea1-2df3-42e8-83b2-086f4c9d1ecc None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:33.371636 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c185ea1-2df3-42e8-83b2-086f4c9d1ecc None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:33.371908 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c185ea1-2df3-42e8-83b2-086f4c9d1ecc None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:33.373211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 492/987] 10.222.0.36 () {54 vars in 961 bytes} [Sat Oct 8 20:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:38:33.380533 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf535e-db9d-4002-a693-c2c80b18afd0 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:33.380991 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf535e-db9d-4002-a693-c2c80b18afd0 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:33.381369 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf535e-db9d-4002-a693-c2c80b18afd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:33.408509 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-c9cf535e-db9d-4002-a693-c2c80b18afd0 None None] MFA Rules not processed for user `017db52cc36f4bdb9448afe74edab753`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:33.409943 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-c9cf535e-db9d-4002-a693-c2c80b18afd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:33.419420 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 496/988] 10.222.0.36 () {58 vars in 1058 bytes} [Sat Oct 8 20:38:33 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:33.430643 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c185ea1-2df3-42e8-83b2-086f4c9d1ecc None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:33.445663 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c185ea1-2df3-42e8-83b2-086f4c9d1ecc None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:33.451346 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb15ee-1357-42e2-beb0-73cdf0ffe2f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:33.451575 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb15ee-1357-42e2-beb0-73cdf0ffe2f4 service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:33.451859 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb15ee-1357-42e2-beb0-73cdf0ffe2f4 service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:33.452936 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb15ee-1357-42e2-beb0-73cdf0ffe2f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:33.462119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb15ee-1357-42e2-beb0-73cdf0ffe2f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:33.464295 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb15ee-1357-42e2-beb0-73cdf0ffe2f4 service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:33.477485 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 493/989] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:36.091788 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46a7f5-43b6-46a6-aaf5-41aa385a1768 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:36.092398 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46a7f5-43b6-46a6-aaf5-41aa385a1768 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:36.092619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46a7f5-43b6-46a6-aaf5-41aa385a1768 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:36.095031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 497/990] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:36.101047 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed702f8-df5b-4e87-8b33-ae76ad0d129e None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:36.101580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed702f8-df5b-4e87-8b33-ae76ad0d129e None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:36.101580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed702f8-df5b-4e87-8b33-ae76ad0d129e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:36.123603 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-7ed702f8-df5b-4e87-8b33-ae76ad0d129e None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:36.125680 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-7ed702f8-df5b-4e87-8b33-ae76ad0d129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:36.135571 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 494/991] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:36.488766 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46a7f5-43b6-46a6-aaf5-41aa385a1768 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:36.532633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46a7f5-43b6-46a6-aaf5-41aa385a1768 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:36.545184 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d842de7-de0b-40cf-a254-fc8568eef9b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:36.547806 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d842de7-de0b-40cf-a254-fc8568eef9b0 service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:36.548812 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d842de7-de0b-40cf-a254-fc8568eef9b0 service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:36.549665 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d842de7-de0b-40cf-a254-fc8568eef9b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:36.573212 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d842de7-de0b-40cf-a254-fc8568eef9b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:36.577453 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d842de7-de0b-40cf-a254-fc8568eef9b0 service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:36.623381 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 498/992] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:36.866149 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ad27c-a4cf-4cd1-b393-71630e0ff065 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:36.866149 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ad27c-a4cf-4cd1-b393-71630e0ff065 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:36.866149 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ad27c-a4cf-4cd1-b393-71630e0ff065 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:36.866418 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 495/993] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:36.875094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71ccb5-2cc0-465c-aecb-108dd1a9c55e None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:36.875548 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71ccb5-2cc0-465c-aecb-108dd1a9c55e None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:36.876025 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71ccb5-2cc0-465c-aecb-108dd1a9c55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:36.902619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-ae71ccb5-2cc0-465c-aecb-108dd1a9c55e None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:36.903970 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-ae71ccb5-2cc0-465c-aecb-108dd1a9c55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:36.919726 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 499/994] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:37.263689 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a7d8b-fbca-49d6-8193-f81a0e4890ed None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:37.264185 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a7d8b-fbca-49d6-8193-f81a0e4890ed None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:37.264270 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a7d8b-fbca-49d6-8193-f81a0e4890ed None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:37.266376 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 496/995] 10.222.0.36 () {54 vars in 963 bytes} [Sat Oct 8 20:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:37.271362 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c09010-9ac6-424d-949b-36e742bd4736 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:37.271789 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c09010-9ac6-424d-949b-36e742bd4736 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:37.272092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c09010-9ac6-424d-949b-36e742bd4736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:37.325708 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-96c09010-9ac6-424d-949b-36e742bd4736 None None] MFA Rules not processed for user `e2efb666066f4caaa7353656984b5bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:37.327101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-96c09010-9ac6-424d-949b-36e742bd4736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:37.419124 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 500/996] 10.222.0.36 () {58 vars in 1060 bytes} [Sat Oct 8 20:38:37 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:37.430930 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a7d8b-fbca-49d6-8193-f81a0e4890ed None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:37.457771 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a7d8b-fbca-49d6-8193-f81a0e4890ed None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:37.462253 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c3f19-1f22-42f1-86b2-38dd0ed2a030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2efb666066f4caaa7353656984b5bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:37.463286 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c3f19-1f22-42f1-86b2-38dd0ed2a030 service cinder] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:37.463801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c3f19-1f22-42f1-86b2-38dd0ed2a030 service cinder] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:37.464308 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c3f19-1f22-42f1-86b2-38dd0ed2a030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:37.475938 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c3f19-1f22-42f1-86b2-38dd0ed2a030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:37.477809 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c3f19-1f22-42f1-86b2-38dd0ed2a030 service cinder] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:37.502478 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 497/997] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:39.162084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411d8d5-e25b-40c1-8932-d9d4655b0322 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:39.162602 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411d8d5-e25b-40c1-8932-d9d4655b0322 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:39.162699 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411d8d5-e25b-40c1-8932-d9d4655b0322 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:39.164172 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 501/998] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:39.169117 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad8fb7-9c30-4def-abea-30c36361d415 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:39.169504 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad8fb7-9c30-4def-abea-30c36361d415 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:39.169665 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad8fb7-9c30-4def-abea-30c36361d415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:39.188992 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-16ad8fb7-9c30-4def-abea-30c36361d415 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:39.190212 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-16ad8fb7-9c30-4def-abea-30c36361d415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:39.197933 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 498/999] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:39.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411d8d5-e25b-40c1-8932-d9d4655b0322 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:39.557119 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411d8d5-e25b-40c1-8932-d9d4655b0322 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:39.562359 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7afb7-8bd1-4358-abba-3eac443b5420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:39.562964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7afb7-8bd1-4358-abba-3eac443b5420 service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:39.563245 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7afb7-8bd1-4358-abba-3eac443b5420 service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:39.563521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7afb7-8bd1-4358-abba-3eac443b5420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:39.572257 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7afb7-8bd1-4358-abba-3eac443b5420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:39.573812 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7afb7-8bd1-4358-abba-3eac443b5420 service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:39.583692 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 502/1000] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:42.029255 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396493-76fd-4578-9a09-fe20d073d923 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:42.029827 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396493-76fd-4578-9a09-fe20d073d923 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:42.029827 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396493-76fd-4578-9a09-fe20d073d923 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:42.031293 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 499/1001] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:42.036656 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948016b2-a136-453c-908e-9d38c69fd05e None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:42.037065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948016b2-a136-453c-908e-9d38c69fd05e None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:42.037207 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948016b2-a136-453c-908e-9d38c69fd05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:42.057156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-948016b2-a136-453c-908e-9d38c69fd05e None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:42.061957 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-948016b2-a136-453c-908e-9d38c69fd05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:42.070120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 503/1002] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:42.419481 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7396493-76fd-4578-9a09-fe20d073d923 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:42.433529 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7396493-76fd-4578-9a09-fe20d073d923 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:42.439322 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6061359-3ac7-42c7-8cf0-5f861a99c3e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:42.439942 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6061359-3ac7-42c7-8cf0-5f861a99c3e9 service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:42.440220 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6061359-3ac7-42c7-8cf0-5f861a99c3e9 service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:42.440489 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6061359-3ac7-42c7-8cf0-5f861a99c3e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:42.448953 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6061359-3ac7-42c7-8cf0-5f861a99c3e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:42.450546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6061359-3ac7-42c7-8cf0-5f861a99c3e9 service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:42.460408 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 500/1003] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:44.891557 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208f765-1c96-4220-abfa-24b904a0d944 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:44.892077 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208f765-1c96-4220-abfa-24b904a0d944 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:44.892077 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208f765-1c96-4220-abfa-24b904a0d944 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:44.893480 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 504/1004] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:38:44.899395 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7eba2-d176-420e-9272-d895a07b182c None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:44.899833 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7eba2-d176-420e-9272-d895a07b182c None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:44.899939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7eba2-d176-420e-9272-d895a07b182c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:44.922908 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-9ac7eba2-d176-420e-9272-d895a07b182c None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:44.923803 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-9ac7eba2-d176-420e-9272-d895a07b182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:44.932204 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 501/1005] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:45.279022 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208f765-1c96-4220-abfa-24b904a0d944 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:45.293295 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208f765-1c96-4220-abfa-24b904a0d944 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:45.298495 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72e032-ee8b-4e4c-9a26-d232a65bb8e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:45.299339 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72e032-ee8b-4e4c-9a26-d232a65bb8e6 service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:45.299821 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72e032-ee8b-4e4c-9a26-d232a65bb8e6 service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:45.300279 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72e032-ee8b-4e4c-9a26-d232a65bb8e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:45.308667 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72e032-ee8b-4e4c-9a26-d232a65bb8e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:45.310529 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72e032-ee8b-4e4c-9a26-d232a65bb8e6 service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:45.320728 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 505/1006] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:47.775548 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c11f79-1b56-4b83-b41f-a4015fc2eab5 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:47.777318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c11f79-1b56-4b83-b41f-a4015fc2eab5 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:47.777318 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c11f79-1b56-4b83-b41f-a4015fc2eab5 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:47.777538 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 502/1007] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:47.783430 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d942b-ff4f-41c3-9ca5-9302a0a67c78 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:47.783891 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d942b-ff4f-41c3-9ca5-9302a0a67c78 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:47.783997 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d942b-ff4f-41c3-9ca5-9302a0a67c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:47.806325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-343d942b-ff4f-41c3-9ca5-9302a0a67c78 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:47.807933 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-343d942b-ff4f-41c3-9ca5-9302a0a67c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:47.818100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 506/1008] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:48.170193 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c11f79-1b56-4b83-b41f-a4015fc2eab5 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:48.184070 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c11f79-1b56-4b83-b41f-a4015fc2eab5 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:48.189337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e216918-87fe-463a-81e3-1b72e2626ad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:48.190110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e216918-87fe-463a-81e3-1b72e2626ad8 service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:48.190462 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e216918-87fe-463a-81e3-1b72e2626ad8 service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:48.190797 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e216918-87fe-463a-81e3-1b72e2626ad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:48.200554 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e216918-87fe-463a-81e3-1b72e2626ad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:48.202694 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e216918-87fe-463a-81e3-1b72e2626ad8 service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:48.212322 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 503/1009] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:51.185503 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b40eff-169a-45c5-b24d-6836d18db45e None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:51.186267 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b40eff-169a-45c5-b24d-6836d18db45e None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:51.186267 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b40eff-169a-45c5-b24d-6836d18db45e None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:51.187739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 507/1010] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:51.192962 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd7e8e-83c1-4244-9567-ddb36396ee29 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:51.193470 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd7e8e-83c1-4244-9567-ddb36396ee29 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:51.193580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd7e8e-83c1-4244-9567-ddb36396ee29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:51.202995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=43 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:51.215096 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-1ecd7e8e-83c1-4244-9567-ddb36396ee29 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:51.216338 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-1ecd7e8e-83c1-4244-9567-ddb36396ee29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:51.225229 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 504/1011] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:51.587426 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b40eff-169a-45c5-b24d-6836d18db45e None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:51.600774 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b40eff-169a-45c5-b24d-6836d18db45e None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:51.605717 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69da987-8248-4b37-bf35-39e3d8fdaded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:51.606347 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69da987-8248-4b37-bf35-39e3d8fdaded service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:51.606624 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69da987-8248-4b37-bf35-39e3d8fdaded service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:51.606892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69da987-8248-4b37-bf35-39e3d8fdaded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:51.615824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69da987-8248-4b37-bf35-39e3d8fdaded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:51.617523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69da987-8248-4b37-bf35-39e3d8fdaded service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:51.627954 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 508/1012] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:53.891625 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afd991-fc0e-4042-877a-cbaf8b87cc33 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:53.892259 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afd991-fc0e-4042-877a-cbaf8b87cc33 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:53.892259 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afd991-fc0e-4042-877a-cbaf8b87cc33 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:53.893503 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 505/1013] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:53.898872 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9f08-6328-44e0-9cd3-b6baa2ae7b0c None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:53.899367 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9f08-6328-44e0-9cd3-b6baa2ae7b0c None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:53.899496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9f08-6328-44e0-9cd3-b6baa2ae7b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:53.919130 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-ec6c9f08-6328-44e0-9cd3-b6baa2ae7b0c None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:53.920314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-ec6c9f08-6328-44e0-9cd3-b6baa2ae7b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:53.928585 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 509/1014] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:54.081704 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576dd74-e8a4-44f6-90c1-6ed5b85e6a0f None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:54.082097 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576dd74-e8a4-44f6-90c1-6ed5b85e6a0f None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:54.082437 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576dd74-e8a4-44f6-90c1-6ed5b85e6a0f None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:54.083824 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 506/1015] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:54.089059 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9404cbd-e2fd-4d1b-a883-621af37702ec None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:54.089346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9404cbd-e2fd-4d1b-a883-621af37702ec None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:54.089624 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9404cbd-e2fd-4d1b-a883-621af37702ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:54.108809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-b9404cbd-e2fd-4d1b-a883-621af37702ec None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:54.110274 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-b9404cbd-e2fd-4d1b-a883-621af37702ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:54.117831 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 510/1016] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:54.280734 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d9e01-c603-4c5c-b343-0bece929127a None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:54.281024 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d9e01-c603-4c5c-b343-0bece929127a None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:54.281330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d9e01-c603-4c5c-b343-0bece929127a None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:54.282677 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 507/1017] 10.222.0.36 () {54 vars in 962 bytes} [Sat Oct 8 20:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:54.287924 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bb565-4296-4df7-beb5-d99f6b5f032c None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:54.288207 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bb565-4296-4df7-beb5-d99f6b5f032c None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:54.288480 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bb565-4296-4df7-beb5-d99f6b5f032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:54.326374 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-e83bb565-4296-4df7-beb5-d99f6b5f032c None None] MFA Rules not processed for user `7210700b41444499b0a6cfe978445247`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:54.327643 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-e83bb565-4296-4df7-beb5-d99f6b5f032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:54.340127 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:38:54.387404 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 511/1018] 10.222.0.36 () {58 vars in 1059 bytes} [Sat Oct 8 20:38:54 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:54.395283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d9e01-c603-4c5c-b343-0bece929127a None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:54.405871 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d9e01-c603-4c5c-b343-0bece929127a None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:54.409466 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3acf06f-fa54-4741-9a8f-9d2df37f8123 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7210700b41444499b0a6cfe978445247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:54.410077 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acf06f-fa54-4741-9a8f-9d2df37f8123 service glance] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:54.410352 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acf06f-fa54-4741-9a8f-9d2df37f8123 service glance] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:54.410623 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acf06f-fa54-4741-9a8f-9d2df37f8123 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:54.419823 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3acf06f-fa54-4741-9a8f-9d2df37f8123 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:54.422147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3acf06f-fa54-4741-9a8f-9d2df37f8123 service glance] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:54.431769 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 508/1019] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:54.461354 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bb565-4296-4df7-beb5-d99f6b5f032c None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:54.473332 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bb565-4296-4df7-beb5-d99f6b5f032c None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:54.478289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522f717-d109-48f1-809c-d801d1f18984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:54.478882 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522f717-d109-48f1-809c-d801d1f18984 service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:54.479163 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522f717-d109-48f1-809c-d801d1f18984 service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:54.479438 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522f717-d109-48f1-809c-d801d1f18984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:54.488368 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522f717-d109-48f1-809c-d801d1f18984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:54.489950 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522f717-d109-48f1-809c-d801d1f18984 service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:54.499872 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 512/1020] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:38:56.999495 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4018ee-e7f0-4ec2-88a6-f337a6d76e18 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:57.000330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4018ee-e7f0-4ec2-88a6-f337a6d76e18 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:57.000330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4018ee-e7f0-4ec2-88a6-f337a6d76e18 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:57.001366 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 509/1021] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:38:57.008563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059691b-3bd7-4b6b-adf5-15672ab1b73c None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:57.009154 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059691b-3bd7-4b6b-adf5-15672ab1b73c None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:57.009154 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059691b-3bd7-4b6b-adf5-15672ab1b73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:57.036753 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-5059691b-3bd7-4b6b-adf5-15672ab1b73c None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:38:57.037989 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-5059691b-3bd7-4b6b-adf5-15672ab1b73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:38:57.045784 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 513/1022] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:38:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:38:57.391753 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4018ee-e7f0-4ec2-88a6-f337a6d76e18 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:38:57.405729 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4018ee-e7f0-4ec2-88a6-f337a6d76e18 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:38:57.410294 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ad986-73dd-428d-bb1a-d20d1a497229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:38:57.410911 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ad986-73dd-428d-bb1a-d20d1a497229 service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:38:57.411171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ad986-73dd-428d-bb1a-d20d1a497229 service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:38:57.411436 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ad986-73dd-428d-bb1a-d20d1a497229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:38:57.420038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ad986-73dd-428d-bb1a-d20d1a497229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:38:57.422155 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ad986-73dd-428d-bb1a-d20d1a497229 service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:38:57.434511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 510/1023] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:38:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:00.099826 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc4a75-2b1a-44e4-bb1f-8b47fd35dee7 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:00.100450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc4a75-2b1a-44e4-bb1f-8b47fd35dee7 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:00.100450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc4a75-2b1a-44e4-bb1f-8b47fd35dee7 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:00.101709 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 514/1024] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:00.107194 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51667-f231-40c5-afa0-888ddda06c3b None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:00.107676 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51667-f231-40c5-afa0-888ddda06c3b None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:00.107799 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51667-f231-40c5-afa0-888ddda06c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:00.134732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-31f51667-f231-40c5-afa0-888ddda06c3b None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:00.140120 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-31f51667-f231-40c5-afa0-888ddda06c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:00.149976 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 511/1025] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:39:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:00.494242 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc4a75-2b1a-44e4-bb1f-8b47fd35dee7 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:00.508755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc4a75-2b1a-44e4-bb1f-8b47fd35dee7 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:00.513634 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e658bf3-4904-4585-8eac-5259a59e1663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:00.514559 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e658bf3-4904-4585-8eac-5259a59e1663 service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:00.514841 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e658bf3-4904-4585-8eac-5259a59e1663 service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:00.515116 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e658bf3-4904-4585-8eac-5259a59e1663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:00.523875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e658bf3-4904-4585-8eac-5259a59e1663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:00.525506 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e658bf3-4904-4585-8eac-5259a59e1663 service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:00.535677 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 515/1026] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:09.774200 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d835-3d00-4e4c-a8c9-20e97ded266c None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:09.774833 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d835-3d00-4e4c-a8c9-20e97ded266c None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:09.774833 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d835-3d00-4e4c-a8c9-20e97ded266c None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:09.776069 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 512/1027] 10.222.0.36 () {54 vars in 918 bytes} [Sat Oct 8 20:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:09.781304 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe99f43-6f58-400a-b3f5-df1306427ca2 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:09.781777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe99f43-6f58-400a-b3f5-df1306427ca2 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:09.781919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe99f43-6f58-400a-b3f5-df1306427ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:09.800827 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-2fe99f43-6f58-400a-b3f5-df1306427ca2 None None] MFA Rules not processed for user `9fc15a49c674447d9d85b17eb70c3db3`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:09.802083 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-2fe99f43-6f58-400a-b3f5-df1306427ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:09.810275 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 516/1028] 10.222.0.36 () {58 vars in 1015 bytes} [Sat Oct 8 20:39:09 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:39:09.825027 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5db64-b38f-4a9c-b737-bf8e873cce21 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:09.825312 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5db64-b38f-4a9c-b737-bf8e873cce21 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:09.825586 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5db64-b38f-4a9c-b737-bf8e873cce21 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:09.827722 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 513/1029] 10.222.0.36 () {54 vars in 918 bytes} [Sat Oct 8 20:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:09.832454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dc0f5-c59a-4e8d-bdac-2cc937a2efd1 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:09.832760 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dc0f5-c59a-4e8d-bdac-2cc937a2efd1 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:09.833030 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dc0f5-c59a-4e8d-bdac-2cc937a2efd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:09.851747 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-9b5dc0f5-c59a-4e8d-bdac-2cc937a2efd1 None None] MFA Rules not processed for user `017db52cc36f4bdb9448afe74edab753`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:09.852939 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-9b5dc0f5-c59a-4e8d-bdac-2cc937a2efd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:09.861451 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 517/1030] 10.222.0.36 () {58 vars in 1015 bytes} [Sat Oct 8 20:39:09 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:10.129653 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=17 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:12.682343 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced15a7-e833-4631-b01d-bb5d561b6879 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:12.683039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced15a7-e833-4631-b01d-bb5d561b6879 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:12.683039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced15a7-e833-4631-b01d-bb5d561b6879 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:12.684206 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 514/1031] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:39:12.689404 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe349a-afc4-4907-9c2d-f4e6ea137309 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:12.689905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe349a-afc4-4907-9c2d-f4e6ea137309 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:12.690014 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe349a-afc4-4907-9c2d-f4e6ea137309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:12.710736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-debe349a-afc4-4907-9c2d-f4e6ea137309 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:12.711921 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-debe349a-afc4-4907-9c2d-f4e6ea137309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:12.719965 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 518/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:39:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:13.060963 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced15a7-e833-4631-b01d-bb5d561b6879 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:13.075319 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced15a7-e833-4631-b01d-bb5d561b6879 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:13.080243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a3579-e06d-4a39-88fb-3a785296253e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:13.080830 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a3579-e06d-4a39-88fb-3a785296253e service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:13.081109 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a3579-e06d-4a39-88fb-3a785296253e service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:13.081381 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a3579-e06d-4a39-88fb-3a785296253e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:13.089183 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a3579-e06d-4a39-88fb-3a785296253e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:13.090773 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a3579-e06d-4a39-88fb-3a785296253e service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:13.100387 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 515/1033] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:14.793751 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879a92c-c4ec-4820-a1e8-c6cab26aa40c None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:14.794315 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879a92c-c4ec-4820-a1e8-c6cab26aa40c None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:14.794433 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879a92c-c4ec-4820-a1e8-c6cab26aa40c None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:14.796656 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 519/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:39:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:14.801643 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f603fda-eb34-470a-8d67-e6371b47f224 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:14.802098 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f603fda-eb34-470a-8d67-e6371b47f224 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:14.802206 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f603fda-eb34-470a-8d67-e6371b47f224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:14.821394 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-0f603fda-eb34-470a-8d67-e6371b47f224 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:14.822622 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-0f603fda-eb34-470a-8d67-e6371b47f224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:14.830556 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 516/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:39:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:15.029660 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879a92c-c4ec-4820-a1e8-c6cab26aa40c None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:15.042649 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879a92c-c4ec-4820-a1e8-c6cab26aa40c None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:15.047483 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f51fb6-a894-4594-b1ff-764100784f8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:15.048000 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f51fb6-a894-4594-b1ff-764100784f8c service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:15.048278 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f51fb6-a894-4594-b1ff-764100784f8c service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:15.048546 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f51fb6-a894-4594-b1ff-764100784f8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:15.056739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f51fb6-a894-4594-b1ff-764100784f8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:15.058335 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f51fb6-a894-4594-b1ff-764100784f8c service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:15.068213 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 520/1036] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:16.764508 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8124710-1ab3-421f-abeb-4146f2473e28 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:16.765142 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8124710-1ab3-421f-abeb-4146f2473e28 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:16.765142 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8124710-1ab3-421f-abeb-4146f2473e28 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:16.766690 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 517/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:16.771452 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020f114-6042-4139-89ab-ad616326aa6e None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:16.771863 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020f114-6042-4139-89ab-ad616326aa6e None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:16.771987 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020f114-6042-4139-89ab-ad616326aa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:16.791392 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-8020f114-6042-4139-89ab-ad616326aa6e None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:16.792564 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-8020f114-6042-4139-89ab-ad616326aa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:16.800261 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 521/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:39:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:16.960448 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8124710-1ab3-421f-abeb-4146f2473e28 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:16.974819 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8124710-1ab3-421f-abeb-4146f2473e28 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:16.979557 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bef4b-c6c7-476e-aa4a-808db884a5b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:16.980142 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bef4b-c6c7-476e-aa4a-808db884a5b1 service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:16.980417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bef4b-c6c7-476e-aa4a-808db884a5b1 service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:16.980686 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bef4b-c6c7-476e-aa4a-808db884a5b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:16.988674 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bef4b-c6c7-476e-aa4a-808db884a5b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:16.990251 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bef4b-c6c7-476e-aa4a-808db884a5b1 service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:16.999136 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 518/1039] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:18.653471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51994e26-18e7-4740-a691-d494f179dd85 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:18.654093 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51994e26-18e7-4740-a691-d494f179dd85 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:18.654093 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51994e26-18e7-4740-a691-d494f179dd85 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:18.655899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 522/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:18.660648 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce81012-4269-4364-abab-517ff08e8a58 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:18.661075 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce81012-4269-4364-abab-517ff08e8a58 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:18.661185 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce81012-4269-4364-abab-517ff08e8a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:18.680659 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-9ce81012-4269-4364-abab-517ff08e8a58 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:18.681846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-9ce81012-4269-4364-abab-517ff08e8a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:18.689719 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 519/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:39:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:18.847824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51994e26-18e7-4740-a691-d494f179dd85 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:18.861812 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51994e26-18e7-4740-a691-d494f179dd85 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:18.866671 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50c336-6fdf-4d01-ab9b-09507e7e466a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:18.867252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50c336-6fdf-4d01-ab9b-09507e7e466a service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:18.867529 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50c336-6fdf-4d01-ab9b-09507e7e466a service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:18.867800 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50c336-6fdf-4d01-ab9b-09507e7e466a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:18.875985 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50c336-6fdf-4d01-ab9b-09507e7e466a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:18.877572 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50c336-6fdf-4d01-ab9b-09507e7e466a service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:18.887824 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 523/1042] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:20.533578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d25eb5-bd77-4bdd-acda-9923afd0dd13 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:20.534151 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d25eb5-bd77-4bdd-acda-9923afd0dd13 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:20.534151 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d25eb5-bd77-4bdd-acda-9923afd0dd13 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:20.535478 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 520/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:20.540219 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62d8fc-687e-4a3f-8f37-6de284e455bc None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:20.540673 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62d8fc-687e-4a3f-8f37-6de284e455bc None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:20.540771 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62d8fc-687e-4a3f-8f37-6de284e455bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:20.560494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-0d62d8fc-687e-4a3f-8f37-6de284e455bc None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:20.562590 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-0d62d8fc-687e-4a3f-8f37-6de284e455bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:20.570268 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 524/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:39:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:20.726023 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d25eb5-bd77-4bdd-acda-9923afd0dd13 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:20.739783 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d25eb5-bd77-4bdd-acda-9923afd0dd13 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:20.744556 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45c700-8199-4b71-82ab-c9f4cfe094ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:20.745140 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c700-8199-4b71-82ab-c9f4cfe094ef service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:20.745417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c700-8199-4b71-82ab-c9f4cfe094ef service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:20.745687 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c700-8199-4b71-82ab-c9f4cfe094ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:20.754011 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45c700-8199-4b71-82ab-c9f4cfe094ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:20.755567 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45c700-8199-4b71-82ab-c9f4cfe094ef service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:20.764829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 521/1045] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:22.353618 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f645e61-119c-4b56-822f-ad294aeb3570 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:22.354168 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f645e61-119c-4b56-822f-ad294aeb3570 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:22.354168 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f645e61-119c-4b56-822f-ad294aeb3570 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:22.355445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 525/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:22.360784 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52a06d-0f4a-4c87-af76-842a71b235d4 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:22.361234 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52a06d-0f4a-4c87-af76-842a71b235d4 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:22.361337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52a06d-0f4a-4c87-af76-842a71b235d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:22.380985 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-bf52a06d-0f4a-4c87-af76-842a71b235d4 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:22.382188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-bf52a06d-0f4a-4c87-af76-842a71b235d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:22.390534 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 522/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:39:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:22.546905 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f645e61-119c-4b56-822f-ad294aeb3570 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:22.559962 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f645e61-119c-4b56-822f-ad294aeb3570 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:22.565306 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c50cd5-448d-4f69-8237-b61ea3c184fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:22.565908 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c50cd5-448d-4f69-8237-b61ea3c184fb service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:22.566194 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c50cd5-448d-4f69-8237-b61ea3c184fb service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:22.566465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c50cd5-448d-4f69-8237-b61ea3c184fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:22.574296 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c50cd5-448d-4f69-8237-b61ea3c184fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:22.575840 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c50cd5-448d-4f69-8237-b61ea3c184fb service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:22.585662 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 526/1048] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:39:24.178390 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833571dd-7936-4d16-af7a-a300e922e5f4 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:24.178956 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833571dd-7936-4d16-af7a-a300e922e5f4 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:24.178956 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833571dd-7936-4d16-af7a-a300e922e5f4 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:24.180270 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 523/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:24.185036 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d5bba-81a6-44d8-9eb3-a5583a988367 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:24.185443 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d5bba-81a6-44d8-9eb3-a5583a988367 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:24.186457 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d5bba-81a6-44d8-9eb3-a5583a988367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:24.205508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-021d5bba-81a6-44d8-9eb3-a5583a988367 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:24.206720 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-021d5bba-81a6-44d8-9eb3-a5583a988367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:24.214307 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 527/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:39:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:39:24.369456 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833571dd-7936-4d16-af7a-a300e922e5f4 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:24.383285 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833571dd-7936-4d16-af7a-a300e922e5f4 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:24.388074 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e0ecc-9d67-4492-9fab-a5083c3ec26b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:24.388710 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e0ecc-9d67-4492-9fab-a5083c3ec26b service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:24.389217 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e0ecc-9d67-4492-9fab-a5083c3ec26b service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:24.389498 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e0ecc-9d67-4492-9fab-a5083c3ec26b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:24.397267 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e0ecc-9d67-4492-9fab-a5083c3ec26b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:24.398857 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e0ecc-9d67-4492-9fab-a5083c3ec26b service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:24.407921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 524/1051] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:26.132493 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b31ba5-1bf5-4652-8051-938d6d440cc9 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:26.133010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b31ba5-1bf5-4652-8051-938d6d440cc9 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:26.133128 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b31ba5-1bf5-4652-8051-938d6d440cc9 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:26.134398 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 528/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:26.140159 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e3c84-0c9c-43f2-8b4a-c04065673c9b None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:26.140560 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e3c84-0c9c-43f2-8b4a-c04065673c9b None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:26.140730 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e3c84-0c9c-43f2-8b4a-c04065673c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:26.159562 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-855e3c84-0c9c-43f2-8b4a-c04065673c9b None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:26.160734 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-855e3c84-0c9c-43f2-8b4a-c04065673c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:26.168321 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 525/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:39:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:26.325007 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b31ba5-1bf5-4652-8051-938d6d440cc9 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:26.332806 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=70 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:26.339496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b31ba5-1bf5-4652-8051-938d6d440cc9 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:26.344365 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2531a-5c9f-45ac-9aea-2d2712bb2531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:26.344942 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2531a-5c9f-45ac-9aea-2d2712bb2531 service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:26.345216 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2531a-5c9f-45ac-9aea-2d2712bb2531 service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:26.345483 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2531a-5c9f-45ac-9aea-2d2712bb2531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:26.353259 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2531a-5c9f-45ac-9aea-2d2712bb2531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:26.354803 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2531a-5c9f-45ac-9aea-2d2712bb2531 service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:26.363959 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 529/1054] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:27.955649 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab1aed-6879-47e7-b8b0-68415733ec34 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:27.956209 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab1aed-6879-47e7-b8b0-68415733ec34 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:27.956209 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab1aed-6879-47e7-b8b0-68415733ec34 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:27.957520 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 526/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:27.962394 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad17d1-7fb7-4145-af22-725e7e4965c2 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:27.962822 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad17d1-7fb7-4145-af22-725e7e4965c2 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:27.962939 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad17d1-7fb7-4145-af22-725e7e4965c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:27.982223 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-92ad17d1-7fb7-4145-af22-725e7e4965c2 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:27.983419 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-92ad17d1-7fb7-4145-af22-725e7e4965c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:27.991314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 530/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:39:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:39:28.149059 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab1aed-6879-47e7-b8b0-68415733ec34 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:28.162515 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab1aed-6879-47e7-b8b0-68415733ec34 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:28.167371 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16917fa-6584-437c-ab20-6ddc238e432a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:28.168008 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16917fa-6584-437c-ab20-6ddc238e432a service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:28.168303 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16917fa-6584-437c-ab20-6ddc238e432a service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:28.168573 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16917fa-6584-437c-ab20-6ddc238e432a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:28.176622 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16917fa-6584-437c-ab20-6ddc238e432a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:28.178383 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16917fa-6584-437c-ab20-6ddc238e432a service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:28.187798 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 527/1057] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:30.489077 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106815c9-a2ba-431b-b3ba-5d1d9ff16f5e None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:30.489633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106815c9-a2ba-431b-b3ba-5d1d9ff16f5e None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:30.489633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106815c9-a2ba-431b-b3ba-5d1d9ff16f5e None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:30.491025 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 531/1058] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:30.496417 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc1680-fd59-4679-b010-8a6bd9bd1eea None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:30.496840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc1680-fd59-4679-b010-8a6bd9bd1eea None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:30.496971 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc1680-fd59-4679-b010-8a6bd9bd1eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:30.516022 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-88dc1680-fd59-4679-b010-8a6bd9bd1eea None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:30.517254 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-88dc1680-fd59-4679-b010-8a6bd9bd1eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:30.524819 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 528/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:39:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:39:30.866682 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106815c9-a2ba-431b-b3ba-5d1d9ff16f5e None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:30.877813 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106815c9-a2ba-431b-b3ba-5d1d9ff16f5e None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:30.881297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc60c0c-1f60-43fb-8cd0-592ebba3878a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:30.881879 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc60c0c-1f60-43fb-8cd0-592ebba3878a service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:30.882187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc60c0c-1f60-43fb-8cd0-592ebba3878a service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:30.882456 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc60c0c-1f60-43fb-8cd0-592ebba3878a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:30.891187 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc60c0c-1f60-43fb-8cd0-592ebba3878a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:30.892589 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc60c0c-1f60-43fb-8cd0-592ebba3878a service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:30.901675 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 532/1060] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:33.427039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a23af8-58d0-416b-9b6c-28625eb043db None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:33.427554 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a23af8-58d0-416b-9b6c-28625eb043db None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:33.427554 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a23af8-58d0-416b-9b6c-28625eb043db None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:33.428848 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 529/1061] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:33.433933 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c871e6-313b-4223-8357-3889defbc214 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:33.434376 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c871e6-313b-4223-8357-3889defbc214 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:33.434489 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c871e6-313b-4223-8357-3889defbc214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:33.453382 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-53c871e6-313b-4223-8357-3889defbc214 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:33.454602 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-53c871e6-313b-4223-8357-3889defbc214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:33.462254 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 533/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:39:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:33.799176 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a23af8-58d0-416b-9b6c-28625eb043db None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:33.809612 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a23af8-58d0-416b-9b6c-28625eb043db None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:33.813054 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279d683-3fec-44c3-b4e7-98a177ce4231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:33.813642 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279d683-3fec-44c3-b4e7-98a177ce4231 service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:33.813946 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279d683-3fec-44c3-b4e7-98a177ce4231 service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:33.814226 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279d683-3fec-44c3-b4e7-98a177ce4231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:33.822739 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279d683-3fec-44c3-b4e7-98a177ce4231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:33.824143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279d683-3fec-44c3-b4e7-98a177ce4231 service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:33.833789 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 530/1063] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:36.506631 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ca947-5aa0-4064-801a-4124795e5c80 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:36.507196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ca947-5aa0-4064-801a-4124795e5c80 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:36.507196 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ca947-5aa0-4064-801a-4124795e5c80 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:36.508479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 534/1064] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:36.513873 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee2c33-c991-49a9-b825-7a167accc111 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:36.514339 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee2c33-c991-49a9-b825-7a167accc111 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:36.514614 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee2c33-c991-49a9-b825-7a167accc111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:36.533733 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-aaee2c33-c991-49a9-b825-7a167accc111 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:36.534931 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-aaee2c33-c991-49a9-b825-7a167accc111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:36.542431 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 531/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:39:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:36.877842 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ca947-5aa0-4064-801a-4124795e5c80 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:36.888287 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ca947-5aa0-4064-801a-4124795e5c80 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:36.891820 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148300d-4ed6-4527-a70f-cee894666eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:36.892403 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148300d-4ed6-4527-a70f-cee894666eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:36.892678 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148300d-4ed6-4527-a70f-cee894666eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:36.892946 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148300d-4ed6-4527-a70f-cee894666eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:36.901604 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148300d-4ed6-4527-a70f-cee894666eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:36.903046 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148300d-4ed6-4527-a70f-cee894666eb3 service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:36.912564 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 535/1066] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:39:39.504686 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9030a17-bc22-4c06-870f-778ad216419c None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:39.505252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9030a17-bc22-4c06-870f-778ad216419c None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:39.505252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9030a17-bc22-4c06-870f-778ad216419c None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:39.506581 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 532/1067] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:39.511718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23241db5-1b36-4866-ac7c-5398ad7db446 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:39.512150 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23241db5-1b36-4866-ac7c-5398ad7db446 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:39.512252 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23241db5-1b36-4866-ac7c-5398ad7db446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:39.531346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-23241db5-1b36-4866-ac7c-5398ad7db446 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:39.532528 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-23241db5-1b36-4866-ac7c-5398ad7db446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:39.540009 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 536/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:39:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:39.876317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9030a17-bc22-4c06-870f-778ad216419c None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:39.886877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9030a17-bc22-4c06-870f-778ad216419c None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:39.890908 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ce595-8ae3-4155-b267-26f44d9bb00b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:39.891536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ce595-8ae3-4155-b267-26f44d9bb00b service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:39.891826 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ce595-8ae3-4155-b267-26f44d9bb00b service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:39.892091 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ce595-8ae3-4155-b267-26f44d9bb00b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:39.900857 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ce595-8ae3-4155-b267-26f44d9bb00b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:39.902307 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ce595-8ae3-4155-b267-26f44d9bb00b service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:39.912051 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 533/1069] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:42.349430 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b32566-bbf2-43c3-b9a1-39a323504ca5 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:42.350010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b32566-bbf2-43c3-b9a1-39a323504ca5 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:42.350010 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b32566-bbf2-43c3-b9a1-39a323504ca5 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:42.351244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 537/1070] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:42.356461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be8fd5-46de-45d4-a521-3d5b10347d6e None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:42.356861 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be8fd5-46de-45d4-a521-3d5b10347d6e None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:42.357012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be8fd5-46de-45d4-a521-3d5b10347d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:42.365210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=61 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:42.378002 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-a6be8fd5-46de-45d4-a521-3d5b10347d6e None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:42.379196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-a6be8fd5-46de-45d4-a521-3d5b10347d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:42.386781 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 534/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:39:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:42.726870 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b32566-bbf2-43c3-b9a1-39a323504ca5 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:42.738210 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b32566-bbf2-43c3-b9a1-39a323504ca5 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:42.741642 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470763c-9e55-498f-a863-c4e0a44ee8f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:42.742262 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470763c-9e55-498f-a863-c4e0a44ee8f7 service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:42.742540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470763c-9e55-498f-a863-c4e0a44ee8f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:42.742809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470763c-9e55-498f-a863-c4e0a44ee8f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:42.752049 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470763c-9e55-498f-a863-c4e0a44ee8f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:42.753463 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470763c-9e55-498f-a863-c4e0a44ee8f7 service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:42.762521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 538/1072] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:45.176719 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a99ec6-075f-4b3e-a74c-c418ac0ed23a None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:45.177280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a99ec6-075f-4b3e-a74c-c418ac0ed23a None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:45.177280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a99ec6-075f-4b3e-a74c-c418ac0ed23a None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:45.178653 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 535/1073] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:45.183933 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9f500-7585-4fd3-8cdb-fd3ea9f4d0b5 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:45.184356 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9f500-7585-4fd3-8cdb-fd3ea9f4d0b5 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:45.184465 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9f500-7585-4fd3-8cdb-fd3ea9f4d0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:45.204487 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-4db9f500-7585-4fd3-8cdb-fd3ea9f4d0b5 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:45.205828 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-4db9f500-7585-4fd3-8cdb-fd3ea9f4d0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:45.213653 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 539/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:39:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:45.552249 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a99ec6-075f-4b3e-a74c-c418ac0ed23a None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:45.562796 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a99ec6-075f-4b3e-a74c-c418ac0ed23a None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:45.566270 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ca3b9-630b-4dd0-a6e4-999573bc9501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:45.566858 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ca3b9-630b-4dd0-a6e4-999573bc9501 service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:45.567137 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ca3b9-630b-4dd0-a6e4-999573bc9501 service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:45.567408 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ca3b9-630b-4dd0-a6e4-999573bc9501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:45.576453 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ca3b9-630b-4dd0-a6e4-999573bc9501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:45.577852 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ca3b9-630b-4dd0-a6e4-999573bc9501 service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:45.586825 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 536/1075] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:48.030261 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfb456-95d8-4a15-a3bb-7cb3a63f2e91 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:48.030828 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfb456-95d8-4a15-a3bb-7cb3a63f2e91 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:48.030828 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfb456-95d8-4a15-a3bb-7cb3a63f2e91 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:48.032159 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 540/1076] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:48.037268 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0eacbf-bf5a-4d92-88e0-da9fdf847e4c None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:48.037648 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0eacbf-bf5a-4d92-88e0-da9fdf847e4c None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:48.037819 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0eacbf-bf5a-4d92-88e0-da9fdf847e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:48.057263 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-1f0eacbf-bf5a-4d92-88e0-da9fdf847e4c None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:48.058481 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-1f0eacbf-bf5a-4d92-88e0-da9fdf847e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:48.067279 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 537/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:39:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:48.400539 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfb456-95d8-4a15-a3bb-7cb3a63f2e91 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:48.411757 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfb456-95d8-4a15-a3bb-7cb3a63f2e91 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:48.415397 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2701d-13e6-473f-b072-9ee22a4db57a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:48.415986 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2701d-13e6-473f-b072-9ee22a4db57a service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:48.416264 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2701d-13e6-473f-b072-9ee22a4db57a service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:48.416534 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2701d-13e6-473f-b072-9ee22a4db57a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:48.425802 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2701d-13e6-473f-b072-9ee22a4db57a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:48.427239 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2701d-13e6-473f-b072-9ee22a4db57a service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:48.436362 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 541/1078] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:50.882951 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf8546-0941-4525-bb29-be706ebb0eee None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:50.883523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf8546-0941-4525-bb29-be706ebb0eee None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:50.883523 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf8546-0941-4525-bb29-be706ebb0eee None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:50.884816 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 538/1079] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:50.890747 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de75e1d-d254-40a2-b25f-7e59e0384ccf None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:50.891163 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de75e1d-d254-40a2-b25f-7e59e0384ccf None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:50.891293 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de75e1d-d254-40a2-b25f-7e59e0384ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:50.910527 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-7de75e1d-d254-40a2-b25f-7e59e0384ccf None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:50.911693 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-7de75e1d-d254-40a2-b25f-7e59e0384ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:50.919227 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 542/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:39:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:51.251065 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf8546-0941-4525-bb29-be706ebb0eee None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:51.261548 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf8546-0941-4525-bb29-be706ebb0eee None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:51.265927 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a934f-c6ea-4821-86eb-5c90e4e16244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:51.266526 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a934f-c6ea-4821-86eb-5c90e4e16244 service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:51.266807 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a934f-c6ea-4821-86eb-5c90e4e16244 service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:51.267100 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a934f-c6ea-4821-86eb-5c90e4e16244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:51.275704 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a934f-c6ea-4821-86eb-5c90e4e16244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:51.277123 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a934f-c6ea-4821-86eb-5c90e4e16244 service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:51.286507 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 539/1081] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:53.657271 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a77d1-9983-41eb-95cf-d9b19f8a7a28 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:53.657835 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a77d1-9983-41eb-95cf-d9b19f8a7a28 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:53.657835 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a77d1-9983-41eb-95cf-d9b19f8a7a28 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:53.659165 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 543/1082] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:53.664439 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a52b85-ce41-4290-8223-7b543729f6da None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:53.664816 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a52b85-ce41-4290-8223-7b543729f6da None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:53.664987 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a52b85-ce41-4290-8223-7b543729f6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:53.683760 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-b4a52b85-ce41-4290-8223-7b543729f6da None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:53.685459 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-b4a52b85-ce41-4290-8223-7b543729f6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:53.693140 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 540/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:39:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:54.035179 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a77d1-9983-41eb-95cf-d9b19f8a7a28 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:54.045828 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a77d1-9983-41eb-95cf-d9b19f8a7a28 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:54.049272 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd09952-d029-49c4-9350-6498cb18935d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:54.049912 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd09952-d029-49c4-9350-6498cb18935d service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:54.050206 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd09952-d029-49c4-9350-6498cb18935d service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:54.050482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd09952-d029-49c4-9350-6498cb18935d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:54.059557 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd09952-d029-49c4-9350-6498cb18935d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:54.061164 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd09952-d029-49c4-9350-6498cb18935d service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:54.070394 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 544/1084] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:39:56.478182 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d4cf4-566a-4e7f-a878-34ce546f64f7 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:56.478710 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d4cf4-566a-4e7f-a878-34ce546f64f7 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:56.478825 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d4cf4-566a-4e7f-a878-34ce546f64f7 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:56.480055 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 541/1085] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:39:56.486072 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f5764-9df9-4245-a60e-c37ec8387ed0 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:56.486524 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f5764-9df9-4245-a60e-c37ec8387ed0 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:56.486659 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f5764-9df9-4245-a60e-c37ec8387ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:56.493925 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=51 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:39:56.506854 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-bb6f5764-9df9-4245-a60e-c37ec8387ed0 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:39:56.508037 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-bb6f5764-9df9-4245-a60e-c37ec8387ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:39:56.515815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 545/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:39:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:39:56.860492 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d4cf4-566a-4e7f-a878-34ce546f64f7 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:39:56.870881 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d4cf4-566a-4e7f-a878-34ce546f64f7 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:39:56.875190 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7e200-97ce-4d19-b6fd-42a2751b1fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:39:56.875790 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e200-97ce-4d19-b6fd-42a2751b1fda service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:39:56.876070 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e200-97ce-4d19-b6fd-42a2751b1fda service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:39:56.876343 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e200-97ce-4d19-b6fd-42a2751b1fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:39:56.885246 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7e200-97ce-4d19-b6fd-42a2751b1fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:39:56.886707 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7e200-97ce-4d19-b6fd-42a2751b1fda service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:39:56.895951 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 542/1087] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:39:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:40:06.501976 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=2 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:40:06.891944 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=26 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:40:21.087917 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4574933-f863-4d2a-b556-e2f83b7c17c8 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:21.088480 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4574933-f863-4d2a-b556-e2f83b7c17c8 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:21.088480 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4574933-f863-4d2a-b556-e2f83b7c17c8 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:21.089826 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 546/1088] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:40:21.095710 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb36a5-28e9-4f97-9b8f-d02b6f541933 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:21.096165 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb36a5-28e9-4f97-9b8f-d02b6f541933 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:21.096267 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb36a5-28e9-4f97-9b8f-d02b6f541933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:21.115830 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-dcdb36a5-28e9-4f97-9b8f-d02b6f541933 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:40:21.117012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-dcdb36a5-28e9-4f97-9b8f-d02b6f541933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:21.124840 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 543/1089] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:40:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:40:21.474368 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e6f08-983c-428b-b9b2-ca06af009454 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:21.474654 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e6f08-983c-428b-b9b2-ca06af009454 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:21.474927 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e6f08-983c-428b-b9b2-ca06af009454 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:21.476234 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 547/1090] 10.222.0.36 () {54 vars in 962 bytes} [Sat Oct 8 20:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:40:21.482362 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be189bc-d1b4-4919-b993-21815e82da2f None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:21.482738 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be189bc-d1b4-4919-b993-21815e82da2f None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:21.483038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be189bc-d1b4-4919-b993-21815e82da2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:21.502238 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-7be189bc-d1b4-4919-b993-21815e82da2f None None] MFA Rules not processed for user `7210700b41444499b0a6cfe978445247`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:40:21.503415 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-7be189bc-d1b4-4919-b993-21815e82da2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:21.509584 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 544/1091] 10.222.0.36 () {58 vars in 1059 bytes} [Sat Oct 8 20:40:21 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:40:21.516854 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e6f08-983c-428b-b9b2-ca06af009454 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:40:21.527109 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e6f08-983c-428b-b9b2-ca06af009454 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:40:21.531231 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41e2a3-8868-410c-bd2a-b52bc084ac7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7210700b41444499b0a6cfe978445247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:40:21.531801 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41e2a3-8868-410c-bd2a-b52bc084ac7a service glance] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:21.532078 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41e2a3-8868-410c-bd2a-b52bc084ac7a service glance] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:21.532350 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41e2a3-8868-410c-bd2a-b52bc084ac7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:21.540946 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41e2a3-8868-410c-bd2a-b52bc084ac7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:40:21.542384 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41e2a3-8868-410c-bd2a-b52bc084ac7a service glance] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:40:21.552006 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 548/1092] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:40:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:40:24.045083 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a1d86-26b6-4832-be74-5abc950e940b None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:24.045666 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a1d86-26b6-4832-be74-5abc950e940b None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:24.045666 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a1d86-26b6-4832-be74-5abc950e940b None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:24.046981 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 545/1093] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:40:24.052116 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3f375-5a63-460d-8fb0-4b754f8e40a5 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:24.052568 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3f375-5a63-460d-8fb0-4b754f8e40a5 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:24.052693 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3f375-5a63-460d-8fb0-4b754f8e40a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:24.072056 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-7be3f375-5a63-460d-8fb0-4b754f8e40a5 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:40:24.073228 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-7be3f375-5a63-460d-8fb0-4b754f8e40a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:24.080832 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 549/1094] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:40:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:40:24.402263 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a1d86-26b6-4832-be74-5abc950e940b None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:40:24.415013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a1d86-26b6-4832-be74-5abc950e940b None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:40:24.420160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d52374-d438-407c-914d-c766420211b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:40:24.420740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d52374-d438-407c-914d-c766420211b6 admin admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:24.421020 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d52374-d438-407c-914d-c766420211b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:24.421291 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d52374-d438-407c-914d-c766420211b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:24.421945 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d52374-d438-407c-914d-c766420211b6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:40:24.423721 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: WARNING py.warnings [None req-16d52374-d438-407c-914d-c766420211b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:40:24.423721 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: warnings.warn(msg) Oct 08 20:40:24.423721 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: Oct 08 20:40:24.424860 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d52374-d438-407c-914d-c766420211b6 admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:40:24.442353 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 546/1095] 10.222.0.36 () {56 vars in 1108 bytes} [Sat Oct 8 20:40:24 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:40:26.992765 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae90369-6157-4609-8fb6-ca49decc8d60 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:26.993297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae90369-6157-4609-8fb6-ca49decc8d60 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:26.993297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae90369-6157-4609-8fb6-ca49decc8d60 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:26.994661 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 550/1096] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:40:27.000675 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb3aa7-18ed-4db8-ae8f-f8010507c616 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:27.001147 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb3aa7-18ed-4db8-ae8f-f8010507c616 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:27.001261 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb3aa7-18ed-4db8-ae8f-f8010507c616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:27.020299 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-6cbb3aa7-18ed-4db8-ae8f-f8010507c616 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:40:27.021480 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-6cbb3aa7-18ed-4db8-ae8f-f8010507c616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:27.029556 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 547/1097] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:40:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:40:27.374450 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae90369-6157-4609-8fb6-ca49decc8d60 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:40:27.387708 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae90369-6157-4609-8fb6-ca49decc8d60 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:40:27.392482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ea50-49a7-4616-a875-dd2ba40b7a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:40:27.393059 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ea50-49a7-4616-a875-dd2ba40b7a76 service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:27.393334 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ea50-49a7-4616-a875-dd2ba40b7a76 service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:27.393604 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ea50-49a7-4616-a875-dd2ba40b7a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:27.401326 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657ea50-49a7-4616-a875-dd2ba40b7a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:40:27.403392 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657ea50-49a7-4616-a875-dd2ba40b7a76 service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:40:27.412271 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 551/1098] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:40:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:40:29.985543 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcc04b-0052-4619-be43-07d5044f50fa None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:29.986188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcc04b-0052-4619-be43-07d5044f50fa None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:29.986188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcc04b-0052-4619-be43-07d5044f50fa None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:29.987440 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 548/1099] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:40:29.992523 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fdcfc-c3ed-4101-8085-89cf8b0c3b67 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:29.992934 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fdcfc-c3ed-4101-8085-89cf8b0c3b67 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:29.993066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fdcfc-c3ed-4101-8085-89cf8b0c3b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:30.011911 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-f28fdcfc-c3ed-4101-8085-89cf8b0c3b67 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:40:30.013744 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-f28fdcfc-c3ed-4101-8085-89cf8b0c3b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:30.021352 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 552/1100] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:40:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:40:30.358763 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcc04b-0052-4619-be43-07d5044f50fa None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:40:30.369547 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcc04b-0052-4619-be43-07d5044f50fa None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:40:30.373579 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758f684-4828-4362-9c97-5d611fdcb093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:40:30.374200 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f684-4828-4362-9c97-5d611fdcb093 service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:30.374483 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f684-4828-4362-9c97-5d611fdcb093 service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:30.374755 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f684-4828-4362-9c97-5d611fdcb093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:30.383261 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f684-4828-4362-9c97-5d611fdcb093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:40:30.384673 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f684-4828-4362-9c97-5d611fdcb093 service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:40:30.394323 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 549/1101] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:40:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:40:32.833495 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc33b-ddaf-4712-bfd3-9027e196f424 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:32.834289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc33b-ddaf-4712-bfd3-9027e196f424 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:32.834289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc33b-ddaf-4712-bfd3-9027e196f424 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:32.835536 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 553/1102] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:40:32.841612 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5084210-fa03-4c16-b4d7-0caed6404299 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:32.842119 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5084210-fa03-4c16-b4d7-0caed6404299 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:32.842238 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5084210-fa03-4c16-b4d7-0caed6404299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:32.860935 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-c5084210-fa03-4c16-b4d7-0caed6404299 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:40:32.862142 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-c5084210-fa03-4c16-b4d7-0caed6404299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:32.869654 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 550/1103] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:40:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:40:33.207512 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dc33b-ddaf-4712-bfd3-9027e196f424 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:40:33.218748 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dc33b-ddaf-4712-bfd3-9027e196f424 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:40:33.222188 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3730ab-c540-4ab7-b73e-1699d781aaf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:40:33.222795 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3730ab-c540-4ab7-b73e-1699d781aaf8 service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:33.223072 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3730ab-c540-4ab7-b73e-1699d781aaf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:33.223339 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3730ab-c540-4ab7-b73e-1699d781aaf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:33.232421 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3730ab-c540-4ab7-b73e-1699d781aaf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:40:33.233844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3730ab-c540-4ab7-b73e-1699d781aaf8 service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:40:33.243084 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 554/1104] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:40:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:40:35.730629 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32920c23-cb5c-450b-8df2-1872a83f8716 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:35.731170 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32920c23-cb5c-450b-8df2-1872a83f8716 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:35.731170 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32920c23-cb5c-450b-8df2-1872a83f8716 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:35.733037 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 551/1105] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:40:35.738595 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e99f7-b1d9-4abc-9865-e1aa63a8e274 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:35.739031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e99f7-b1d9-4abc-9865-e1aa63a8e274 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:35.739141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e99f7-b1d9-4abc-9865-e1aa63a8e274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:35.760074 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-882e99f7-b1d9-4abc-9865-e1aa63a8e274 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:40:35.761243 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-882e99f7-b1d9-4abc-9865-e1aa63a8e274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:35.769353 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 555/1106] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:40:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:40:36.111890 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32920c23-cb5c-450b-8df2-1872a83f8716 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:40:36.123138 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32920c23-cb5c-450b-8df2-1872a83f8716 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:40:36.127275 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a5133-a00b-4758-9a51-d0549b8e69ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:40:36.127882 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a5133-a00b-4758-9a51-d0549b8e69ee service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:36.128164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a5133-a00b-4758-9a51-d0549b8e69ee service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:36.128438 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a5133-a00b-4758-9a51-d0549b8e69ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:36.137282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a5133-a00b-4758-9a51-d0549b8e69ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:40:36.138915 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a5133-a00b-4758-9a51-d0549b8e69ee service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:40:36.148072 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 552/1107] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:40:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:40:38.780160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b91d2-34c8-46fd-a593-d405bedec0c0 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:38.780722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b91d2-34c8-46fd-a593-d405bedec0c0 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:38.780722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b91d2-34c8-46fd-a593-d405bedec0c0 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:38.782195 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 556/1108] 10.222.0.36 () {54 vars in 927 bytes} [Sat Oct 8 20:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:40:38.787313 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054a45e-065e-46f7-a366-5ab4e52a7683 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:38.787785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054a45e-065e-46f7-a366-5ab4e52a7683 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:38.787935 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054a45e-065e-46f7-a366-5ab4e52a7683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:38.807181 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-9054a45e-065e-46f7-a366-5ab4e52a7683 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:40:38.808433 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-9054a45e-065e-46f7-a366-5ab4e52a7683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:40:38.816882 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 553/1109] 10.222.0.36 () {58 vars in 1024 bytes} [Sat Oct 8 20:40:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:40:39.167411 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b91d2-34c8-46fd-a593-d405bedec0c0 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:40:39.178771 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b91d2-34c8-46fd-a593-d405bedec0c0 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:40:39.182212 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e6a7d-d349-44bb-96cb-03394d403103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:40:39.182797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e6a7d-d349-44bb-96cb-03394d403103 service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:40:39.183072 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e6a7d-d349-44bb-96cb-03394d403103 service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:40:39.183342 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e6a7d-d349-44bb-96cb-03394d403103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:40:39.192148 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e6a7d-d349-44bb-96cb-03394d403103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:40:39.193544 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e6a7d-d349-44bb-96cb-03394d403103 service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:40:39.203277 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 557/1110] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:40:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:40:48.802261 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=33 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:40:49.198906 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=33 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:00.704872 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a616d9a-66ba-41af-b064-22a4c6fcb330 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:00.705510 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a616d9a-66ba-41af-b064-22a4c6fcb330 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:00.705510 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a616d9a-66ba-41af-b064-22a4c6fcb330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:00.725432 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-7a616d9a-66ba-41af-b064-22a4c6fcb330 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:00.726674 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-7a616d9a-66ba-41af-b064-22a4c6fcb330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:00.735187 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 554/1111] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:42:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:00.743203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad384e-826c-4d31-a62b-d0a7a4481337 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:00.743722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad384e-826c-4d31-a62b-d0a7a4481337 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:00.743722 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad384e-826c-4d31-a62b-d0a7a4481337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:00.762761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-b2ad384e-826c-4d31-a62b-d0a7a4481337 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:00.763955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-b2ad384e-826c-4d31-a62b-d0a7a4481337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:00.771576 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 558/1112] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:42:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:00.775984 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a616d9a-66ba-41af-b064-22a4c6fcb330 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:00.785953 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a616d9a-66ba-41af-b064-22a4c6fcb330 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:00.790347 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbed80-d855-404d-a88d-66433646b982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:00.790933 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbed80-d855-404d-a88d-66433646b982 admin admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:00.791210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbed80-d855-404d-a88d-66433646b982 admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:00.791478 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbed80-d855-404d-a88d-66433646b982 admin admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:00.792103 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbed80-d855-404d-a88d-66433646b982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:42:00.792402 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbed80-d855-404d-a88d-66433646b982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:00.794113 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: WARNING py.warnings [None req-5afbed80-d855-404d-a88d-66433646b982 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:42:00.794113 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: warnings.warn(msg) Oct 08 20:42:00.794113 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: Oct 08 20:42:00.794989 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbed80-d855-404d-a88d-66433646b982 admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:00.805963 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 555/1113] 10.222.0.36 () {58 vars in 1153 bytes} [Sat Oct 8 20:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:42:00.814043 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad384e-826c-4d31-a62b-d0a7a4481337 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:00.822991 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad384e-826c-4d31-a62b-d0a7a4481337 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:00.827736 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ab8cb-07e0-4022-9c73-cb3bc88c3e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:00.828324 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ab8cb-07e0-4022-9c73-cb3bc88c3e6a admin admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:00.828602 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ab8cb-07e0-4022-9c73-cb3bc88c3e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:00.828987 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ab8cb-07e0-4022-9c73-cb3bc88c3e6a admin admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:00.829488 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ab8cb-07e0-4022-9c73-cb3bc88c3e6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:00.831300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: WARNING py.warnings [None req-027ab8cb-07e0-4022-9c73-cb3bc88c3e6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:42:00.831300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: warnings.warn(msg) Oct 08 20:42:00.831300 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: Oct 08 20:42:00.832481 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ab8cb-07e0-4022-9c73-cb3bc88c3e6a admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:00.860003 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 559/1114] 10.222.0.36 () {60 vars in 1153 bytes} [Sat Oct 8 20:42:00 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:42:00.864165 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbed80-d855-404d-a88d-66433646b982 admin admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:00.875530 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbed80-d855-404d-a88d-66433646b982 admin admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:00.930126 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38608cbc-2be3-4691-b613-b390387b393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:00.930724 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38608cbc-2be3-4691-b613-b390387b393a admin admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:00.931002 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38608cbc-2be3-4691-b613-b390387b393a admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:00.931279 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38608cbc-2be3-4691-b613-b390387b393a admin admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:00.931924 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38608cbc-2be3-4691-b613-b390387b393a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:00.932904 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: WARNING py.warnings [None req-38608cbc-2be3-4691-b613-b390387b393a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:42:00.932904 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: warnings.warn(msg) Oct 08 20:42:00.932904 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: Oct 08 20:42:00.934777 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38608cbc-2be3-4691-b613-b390387b393a admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:00.955776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 556/1115] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Oct 8 20:42:00 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:42:00.959986 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ab8cb-07e0-4022-9c73-cb3bc88c3e6a admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:00.970413 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ab8cb-07e0-4022-9c73-cb3bc88c3e6a admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:00.974871 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87248cb-0881-4622-ab98-af5b18926479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:00.975454 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87248cb-0881-4622-ab98-af5b18926479 admin admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:00.975729 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87248cb-0881-4622-ab98-af5b18926479 admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:00.976029 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87248cb-0881-4622-ab98-af5b18926479 admin admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:00.976657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87248cb-0881-4622-ab98-af5b18926479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:00.977640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: WARNING py.warnings [None req-c87248cb-0881-4622-ab98-af5b18926479 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:42:00.977640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: warnings.warn(msg) Oct 08 20:42:00.977640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: Oct 08 20:42:00.978538 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87248cb-0881-4622-ab98-af5b18926479 admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:00.991145 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 560/1116] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Oct 8 20:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:42:00.995012 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38608cbc-2be3-4691-b613-b390387b393a admin admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:01.004756 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38608cbc-2be3-4691-b613-b390387b393a admin admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:01.009276 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe17f14-94e9-41d1-a536-c6d87627dfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:01.009903 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe17f14-94e9-41d1-a536-c6d87627dfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:01.010196 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe17f14-94e9-41d1-a536-c6d87627dfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:01.010469 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe17f14-94e9-41d1-a536-c6d87627dfa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:01.011123 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe17f14-94e9-41d1-a536-c6d87627dfa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:01.012969 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: WARNING py.warnings [None req-fbe17f14-94e9-41d1-a536-c6d87627dfa1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:42:01.012969 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: warnings.warn(msg) Oct 08 20:42:01.012969 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: Oct 08 20:42:01.013832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe17f14-94e9-41d1-a536-c6d87627dfa1 admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:01.026717 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 557/1117] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Oct 8 20:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:42:01.031626 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87248cb-0881-4622-ab98-af5b18926479 admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:01.041379 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87248cb-0881-4622-ab98-af5b18926479 admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:01.045941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bb853-2149-46d8-83cc-ec0301b6f46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:01.046584 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bb853-2149-46d8-83cc-ec0301b6f46b admin admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:01.046864 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bb853-2149-46d8-83cc-ec0301b6f46b admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:01.047137 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bb853-2149-46d8-83cc-ec0301b6f46b admin admin] PATH_INFO: `/v3/projects/0dded513e5bc42c392878d25a68bbacd/users/47fdb4e0178c46e5b55d90d25f6d311c/roles/fc58707301804afca34ac8fe194639ed` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:01.062122 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bb853-2149-46d8-83cc-ec0301b6f46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dded513e5bc42c392878d25a68bbacd, user_id=47fdb4e0178c46e5b55d90d25f6d311c, role_id=fc58707301804afca34ac8fe194639ed)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:01.063146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: WARNING py.warnings [None req-c98bb853-2149-46d8-83cc-ec0301b6f46b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:42:01.063146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: warnings.warn(msg) Oct 08 20:42:01.063146 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: Oct 08 20:42:01.065035 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bb853-2149-46d8-83cc-ec0301b6f46b admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:01.078339 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 561/1118] 10.222.0.36 () {60 vars in 1483 bytes} [Sat Oct 8 20:42:01 2022] PUT /identity/v3/projects/0dded513e5bc42c392878d25a68bbacd/users/47fdb4e0178c46e5b55d90d25f6d311c/roles/fc58707301804afca34ac8fe194639ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:42:01.091054 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fdb98-4403-47ff-8c6d-82777446976f None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:01.091337 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fdb98-4403-47ff-8c6d-82777446976f None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:01.091607 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fdb98-4403-47ff-8c6d-82777446976f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:01.118899 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-a08fdb98-4403-47ff-8c6d-82777446976f None None] MFA Rules not processed for user `47fdb4e0178c46e5b55d90d25f6d311c`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:01.120095 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-a08fdb98-4403-47ff-8c6d-82777446976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:01.181602 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 558/1119] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:42:01 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:01.195342 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b5dcb-d6c1-49bf-b302-4f9fd6268b44 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:01.195630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b5dcb-d6c1-49bf-b302-4f9fd6268b44 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:01.195908 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b5dcb-d6c1-49bf-b302-4f9fd6268b44 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:01.197230 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 562/1120] 10.222.0.36 () {54 vars in 963 bytes} [Sat Oct 8 20:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:01.202555 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0fe77-f8bd-4905-95a5-289434fefeaf None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:01.202839 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0fe77-f8bd-4905-95a5-289434fefeaf None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:01.203110 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0fe77-f8bd-4905-95a5-289434fefeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:01.224037 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-b8e0fe77-f8bd-4905-95a5-289434fefeaf None None] MFA Rules not processed for user `e2efb666066f4caaa7353656984b5bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:01.225164 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-b8e0fe77-f8bd-4905-95a5-289434fefeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:01.267186 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:01.275084 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 559/1121] 10.222.0.36 () {58 vars in 1060 bytes} [Sat Oct 8 20:42:01 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:42:01.283419 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b5dcb-d6c1-49bf-b302-4f9fd6268b44 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:01.293968 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b5dcb-d6c1-49bf-b302-4f9fd6268b44 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:01.297357 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe854b-3c6c-4350-9cf3-05ce0810f204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2efb666066f4caaa7353656984b5bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:01.297975 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe854b-3c6c-4350-9cf3-05ce0810f204 service cinder] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:01.298254 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe854b-3c6c-4350-9cf3-05ce0810f204 service cinder] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:01.298522 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe854b-3c6c-4350-9cf3-05ce0810f204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:01.306408 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe854b-3c6c-4350-9cf3-05ce0810f204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:01.307815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe854b-3c6c-4350-9cf3-05ce0810f204 service cinder] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:01.316348 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 563/1122] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:01 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:01.354752 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfcfe6-5a9b-4e4a-9211-8e4da7f608df None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:01.355039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfcfe6-5a9b-4e4a-9211-8e4da7f608df None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:01.355530 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfcfe6-5a9b-4e4a-9211-8e4da7f608df None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:01.356757 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 560/1123] 10.222.0.36 () {52 vars in 830 bytes} [Sat Oct 8 20:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:42:01.360597 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe854b-3c6c-4350-9cf3-05ce0810f204 service cinder] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:01.420200 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe854b-3c6c-4350-9cf3-05ce0810f204 service cinder] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:01.424697 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25de18-27b5-4f9f-a87e-1f3ecd916345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:01.425316 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25de18-27b5-4f9f-a87e-1f3ecd916345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:01.425594 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25de18-27b5-4f9f-a87e-1f3ecd916345 admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:01.425869 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25de18-27b5-4f9f-a87e-1f3ecd916345 admin admin] PATH_INFO: `/v3/users/47fdb4e0178c46e5b55d90d25f6d311c` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:01.427013 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25de18-27b5-4f9f-a87e-1f3ecd916345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47fdb4e0178c46e5b55d90d25f6d311c)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:01.428021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: WARNING py.warnings [None req-cb25de18-27b5-4f9f-a87e-1f3ecd916345 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:42:01.428021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: warnings.warn(msg) Oct 08 20:42:01.428021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: Oct 08 20:42:01.429206 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25de18-27b5-4f9f-a87e-1f3ecd916345 admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:01.493161 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-cb25de18-27b5-4f9f-a87e-1f3ecd916345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47fdb4e0178c46e5b55d90d25f6d311c'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:42:01.507372 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-cb25de18-27b5-4f9f-a87e-1f3ecd916345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47fdb4e0178c46e5b55d90d25f6d311c'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:42:01.508033 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-cb25de18-27b5-4f9f-a87e-1f3ecd916345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47fdb4e0178c46e5b55d90d25f6d311c'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:42:01.508747 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-cb25de18-27b5-4f9f-a87e-1f3ecd916345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47fdb4e0178c46e5b55d90d25f6d311c'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:42:01.531854 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-cb25de18-27b5-4f9f-a87e-1f3ecd916345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47fdb4e0178c46e5b55d90d25f6d311c'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:42:01.546531 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 564/1124] 10.222.0.36 () {58 vars in 1224 bytes} [Sat Oct 8 20:42:01 2022] DELETE /identity/v3/users/47fdb4e0178c46e5b55d90d25f6d311c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:42:01.550931 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7785d5-95ea-4682-8a6b-419573da6441 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:01.551215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7785d5-95ea-4682-8a6b-419573da6441 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:01.551484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7785d5-95ea-4682-8a6b-419573da6441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:01.569699 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-ee7785d5-95ea-4682-8a6b-419573da6441 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:42:01.570923 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-ee7785d5-95ea-4682-8a6b-419573da6441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:01.627776 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 561/1125] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:42:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:42:01.637397 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25de18-27b5-4f9f-a87e-1f3ecd916345 admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:01.638788 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-cb25de18-27b5-4f9f-a87e-1f3ecd916345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:01.644243 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:01.697292 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25de18-27b5-4f9f-a87e-1f3ecd916345 admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:01.701121 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2559f7c-be03-4340-ba38-74615c66ac14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:01.701720 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2559f7c-be03-4340-ba38-74615c66ac14 service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:01.702043 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2559f7c-be03-4340-ba38-74615c66ac14 service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:01.702315 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2559f7c-be03-4340-ba38-74615c66ac14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:01.711350 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2559f7c-be03-4340-ba38-74615c66ac14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:01.712774 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2559f7c-be03-4340-ba38-74615c66ac14 service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:01.722730 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 565/1126] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:42:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:42:02.064116 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7785d5-95ea-4682-8a6b-419573da6441 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:42:02.065588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-ee7785d5-95ea-4682-8a6b-419573da6441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:42:02.077683 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7785d5-95ea-4682-8a6b-419573da6441 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:42:02.082342 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:42:02.082970 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:42:02.083252 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:42:02.083711 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f admin admin] PATH_INFO: `/v3/projects/0dded513e5bc42c392878d25a68bbacd` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:42:02.084919 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dded513e5bc42c392878d25a68bbacd)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:42:02.085837 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: WARNING py.warnings [None req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:42:02.085837 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: warnings.warn(msg) Oct 08 20:42:02.085837 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: Oct 08 20:42:02.087072 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:42:02.146274 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dded513e5bc42c392878d25a68bbacd', 'request_id': 'req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:42:02.152718 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dded513e5bc42c392878d25a68bbacd', 'request_id': 'req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:42:02.163075 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dded513e5bc42c392878d25a68bbacd', 'request_id': 'req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:42:02.181587 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f admin admin] The token cache is being invalidate because project 0dded513e5bc42c392878d25a68bbacd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:42:02.181877 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:42:02.182629 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-3db43ab7-c5e7-4fce-abc3-cb597a9a8c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:42:02.184135 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 562/1127] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 8 20:42:02 2022] DELETE /identity/v3/projects/0dded513e5bc42c392878d25a68bbacd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:42:11.718540 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=25 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:42:12.178675 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:29.744172 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765b04e-f05b-4fba-bf77-6d752df36cdb None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:29.744777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765b04e-f05b-4fba-bf77-6d752df36cdb None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:29.744777 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765b04e-f05b-4fba-bf77-6d752df36cdb None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:29.746117 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 566/1128] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:29.750921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bce6f-4075-49bf-be71-6729921fe46b None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:29.751326 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bce6f-4075-49bf-be71-6729921fe46b None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:29.751465 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bce6f-4075-49bf-be71-6729921fe46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:29.818953 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-a99bce6f-4075-49bf-be71-6729921fe46b None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:29.820170 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-a99bce6f-4075-49bf-be71-6729921fe46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:29.914796 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 563/1129] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:43:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:30.074645 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765b04e-f05b-4fba-bf77-6d752df36cdb None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:30.076362 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-5765b04e-f05b-4fba-bf77-6d752df36cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:30.165557 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765b04e-f05b-4fba-bf77-6d752df36cdb None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:30.171137 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568e01d-8ae2-469a-b73e-4619565fc7ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:30.171738 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568e01d-8ae2-469a-b73e-4619565fc7ef service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:30.172007 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568e01d-8ae2-469a-b73e-4619565fc7ef service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:30.172273 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568e01d-8ae2-469a-b73e-4619565fc7ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:30.180086 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568e01d-8ae2-469a-b73e-4619565fc7ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:30.181629 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568e01d-8ae2-469a-b73e-4619565fc7ef service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:30.190695 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 567/1130] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:31.822027 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38d096-bda6-4c68-9200-e50b18e18c62 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:31.822541 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38d096-bda6-4c68-9200-e50b18e18c62 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:31.822653 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38d096-bda6-4c68-9200-e50b18e18c62 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:31.824461 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 564/1131] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:31.829413 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646bf8b-1ab4-43e1-b14b-1aac3e72d412 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:31.829933 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646bf8b-1ab4-43e1-b14b-1aac3e72d412 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:31.830050 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646bf8b-1ab4-43e1-b14b-1aac3e72d412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:31.849620 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-d646bf8b-1ab4-43e1-b14b-1aac3e72d412 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:31.850837 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-d646bf8b-1ab4-43e1-b14b-1aac3e72d412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:31.858842 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 568/1132] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:43:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:32.019909 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38d096-bda6-4c68-9200-e50b18e18c62 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:32.035282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38d096-bda6-4c68-9200-e50b18e18c62 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:32.040203 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb983f4-2574-4dac-83c9-3fc905cd8e8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:32.040788 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb983f4-2574-4dac-83c9-3fc905cd8e8e service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:32.041062 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb983f4-2574-4dac-83c9-3fc905cd8e8e service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:32.041329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb983f4-2574-4dac-83c9-3fc905cd8e8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:32.049062 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb983f4-2574-4dac-83c9-3fc905cd8e8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:32.051130 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb983f4-2574-4dac-83c9-3fc905cd8e8e service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:32.061380 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 565/1133] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:35.265241 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e87a-e93e-4fe9-9df5-de15755df722 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:35.265790 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e87a-e93e-4fe9-9df5-de15755df722 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:35.265790 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e87a-e93e-4fe9-9df5-de15755df722 None None] PATH_INFO: `/v3` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:35.267051 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 569/1134] 10.222.0.20 () {54 vars in 925 bytes} [Sat Oct 8 20:43:35 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 08 20:43:35.280025 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b7965-daca-4232-9080-589e795f0a22 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:35.280431 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b7965-daca-4232-9080-589e795f0a22 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:35.280580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b7965-daca-4232-9080-589e795f0a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:35.310679 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-176b7965-daca-4232-9080-589e795f0a22 None None] MFA Rules not processed for user `9fc15a49c674447d9d85b17eb70c3db3`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:35.311815 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-176b7965-daca-4232-9080-589e795f0a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:35.365336 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:35.374887 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 566/1135] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Oct 8 20:43:35 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:39.353011 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be5242-712c-4679-9367-b16223dfd6d5 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:39.353446 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be5242-712c-4679-9367-b16223dfd6d5 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:39.353543 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be5242-712c-4679-9367-b16223dfd6d5 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:39.355473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 570/1136] 10.222.0.36 () {54 vars in 961 bytes} [Sat Oct 8 20:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:39.360842 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c32fa0-6a37-4eb3-b819-e327fd78d15f None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:39.361278 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c32fa0-6a37-4eb3-b819-e327fd78d15f None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:39.361375 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c32fa0-6a37-4eb3-b819-e327fd78d15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:39.381039 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-c1c32fa0-6a37-4eb3-b819-e327fd78d15f None None] MFA Rules not processed for user `9fc15a49c674447d9d85b17eb70c3db3`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:39.382264 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-c1c32fa0-6a37-4eb3-b819-e327fd78d15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:39.390941 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 567/1137] 10.222.0.36 () {58 vars in 1058 bytes} [Sat Oct 8 20:43:39 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:39.397694 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be5242-712c-4679-9367-b16223dfd6d5 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:39.411319 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be5242-712c-4679-9367-b16223dfd6d5 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:39.416286 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811ebbe-12a8-464c-a98b-ac1aa09c2dba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc15a49c674447d9d85b17eb70c3db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:39.416860 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811ebbe-12a8-464c-a98b-ac1aa09c2dba service placement] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:39.417135 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811ebbe-12a8-464c-a98b-ac1aa09c2dba service placement] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:39.417403 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811ebbe-12a8-464c-a98b-ac1aa09c2dba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:39.425956 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811ebbe-12a8-464c-a98b-ac1aa09c2dba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:39.427494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811ebbe-12a8-464c-a98b-ac1aa09c2dba service placement] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:39.437311 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 571/1138] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:39 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:43:44.056429 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b78ed-59fe-459f-8c71-149666468cb7 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:44.056876 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b78ed-59fe-459f-8c71-149666468cb7 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:44.056987 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b78ed-59fe-459f-8c71-149666468cb7 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:44.058979 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:44.063704 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b5496-607e-4234-bd56-50a69cc67710 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:44.064148 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b5496-607e-4234-bd56-50a69cc67710 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:44.064257 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b5496-607e-4234-bd56-50a69cc67710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:44.083678 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-bb9b5496-607e-4234-bd56-50a69cc67710 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:44.084857 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-bb9b5496-607e-4234-bd56-50a69cc67710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:44.092467 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 572/1140] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:43:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:44.251216 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b78ed-59fe-459f-8c71-149666468cb7 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:44.265239 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b78ed-59fe-459f-8c71-149666468cb7 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:44.270131 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e40049-48d0-47c3-bf08-f91577f611dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:44.270724 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e40049-48d0-47c3-bf08-f91577f611dd service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:44.271006 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e40049-48d0-47c3-bf08-f91577f611dd service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:44.271280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e40049-48d0-47c3-bf08-f91577f611dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:44.279296 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e40049-48d0-47c3-bf08-f91577f611dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:44.280856 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e40049-48d0-47c3-bf08-f91577f611dd service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:44.290573 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 569/1141] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:43:45.907752 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52716f9-b73f-42ad-ba12-3ff6e2781ab5 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:45.908313 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52716f9-b73f-42ad-ba12-3ff6e2781ab5 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:45.908313 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52716f9-b73f-42ad-ba12-3ff6e2781ab5 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:45.909676 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 573/1142] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 8 20:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:45.914612 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68c9a2-d5be-4efa-babd-dadc68f40330 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:45.914998 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68c9a2-d5be-4efa-babd-dadc68f40330 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:45.915161 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68c9a2-d5be-4efa-babd-dadc68f40330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:45.934915 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-be68c9a2-d5be-4efa-babd-dadc68f40330 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:45.936102 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-be68c9a2-d5be-4efa-babd-dadc68f40330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:45.943738 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 570/1143] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 8 20:43:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:46.103508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52716f9-b73f-42ad-ba12-3ff6e2781ab5 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:46.117175 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52716f9-b73f-42ad-ba12-3ff6e2781ab5 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:46.122265 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04af0bd-08ab-44dc-99b2-a5744649d16a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:46.122852 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04af0bd-08ab-44dc-99b2-a5744649d16a service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:46.123131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04af0bd-08ab-44dc-99b2-a5744649d16a service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:46.123403 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04af0bd-08ab-44dc-99b2-a5744649d16a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:46.131302 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04af0bd-08ab-44dc-99b2-a5744649d16a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:46.132855 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04af0bd-08ab-44dc-99b2-a5744649d16a service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:46.142762 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 574/1144] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:50.473184 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d25329-5427-4622-b983-b8b9d9f0ce04 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:50.473734 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d25329-5427-4622-b983-b8b9d9f0ce04 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:50.473734 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d25329-5427-4622-b983-b8b9d9f0ce04 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:50.475071 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 571/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:50.480861 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc840e-111c-4dc0-880d-d8bf11408f7c None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:50.481291 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc840e-111c-4dc0-880d-d8bf11408f7c None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:50.481440 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc840e-111c-4dc0-880d-d8bf11408f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:50.501337 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-6dcc840e-111c-4dc0-880d-d8bf11408f7c None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:50.502544 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-6dcc840e-111c-4dc0-880d-d8bf11408f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:50.510102 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 575/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:43:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:50.861572 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d25329-5427-4622-b983-b8b9d9f0ce04 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:50.863272 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-31d25329-5427-4622-b983-b8b9d9f0ce04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:50.918892 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d25329-5427-4622-b983-b8b9d9f0ce04 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:50.922396 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634ab10-dd88-4045-a766-a9d895306cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:50.922994 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634ab10-dd88-4045-a766-a9d895306cbd service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:50.923274 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634ab10-dd88-4045-a766-a9d895306cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:50.923545 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634ab10-dd88-4045-a766-a9d895306cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:50.932192 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634ab10-dd88-4045-a766-a9d895306cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:50.934324 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634ab10-dd88-4045-a766-a9d895306cbd service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:50.943314 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 572/1147] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:53.313439 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0f016-1c5d-4fe1-ac3d-97f38da648fb None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:53.314021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0f016-1c5d-4fe1-ac3d-97f38da648fb None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:53.314021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0f016-1c5d-4fe1-ac3d-97f38da648fb None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:53.315307 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 576/1148] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:43:53.320518 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ce8c9-770d-479b-aad4-577a4ec23aab None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:53.320960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ce8c9-770d-479b-aad4-577a4ec23aab None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:53.321063 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ce8c9-770d-479b-aad4-577a4ec23aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:53.340580 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-a09ce8c9-770d-479b-aad4-577a4ec23aab None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:53.341750 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-a09ce8c9-770d-479b-aad4-577a4ec23aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:53.349315 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 573/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:43:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:53.688442 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0f016-1c5d-4fe1-ac3d-97f38da648fb None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:53.694235 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=61 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:43:53.703482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0f016-1c5d-4fe1-ac3d-97f38da648fb None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:53.706908 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545e6b5-e0ad-4035-8d16-82bc7742eedc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:53.707508 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545e6b5-e0ad-4035-8d16-82bc7742eedc service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:53.707787 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545e6b5-e0ad-4035-8d16-82bc7742eedc service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:53.708058 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545e6b5-e0ad-4035-8d16-82bc7742eedc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:53.716999 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545e6b5-e0ad-4035-8d16-82bc7742eedc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:53.718489 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545e6b5-e0ad-4035-8d16-82bc7742eedc service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:53.727649 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 577/1150] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:43:57.684143 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2342-9604-4067-91e1-55d2c41f8453 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:57.684710 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2342-9604-4067-91e1-55d2c41f8453 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:57.684710 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2342-9604-4067-91e1-55d2c41f8453 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:57.686040 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 574/1151] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:43:57.691253 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e2e2d-16b2-4ec4-8b7e-e35ffd20ba71 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:57.691630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e2e2d-16b2-4ec4-8b7e-e35ffd20ba71 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:57.691804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e2e2d-16b2-4ec4-8b7e-e35ffd20ba71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:57.710906 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-179e2e2d-16b2-4ec4-8b7e-e35ffd20ba71 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:43:57.712094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-179e2e2d-16b2-4ec4-8b7e-e35ffd20ba71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:57.720889 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 578/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:43:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:43:58.076656 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f2342-9604-4067-91e1-55d2c41f8453 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:43:58.078436 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-ad5f2342-9604-4067-91e1-55d2c41f8453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:43:58.145832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f2342-9604-4067-91e1-55d2c41f8453 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:43:58.149235 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da000237-2afb-45cb-a48f-23dcc637fdce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2efb666066f4caaa7353656984b5bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:43:58.149826 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da000237-2afb-45cb-a48f-23dcc637fdce service cinder] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:43:58.150134 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da000237-2afb-45cb-a48f-23dcc637fdce service cinder] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:43:58.150402 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da000237-2afb-45cb-a48f-23dcc637fdce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:43:58.159219 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da000237-2afb-45cb-a48f-23dcc637fdce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:43:58.160607 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da000237-2afb-45cb-a48f-23dcc637fdce service cinder] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:43:58.170131 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 575/1153] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:43:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:44:00.581347 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c3b20-52b5-40fc-bede-53cf656f690d None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:00.581941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c3b20-52b5-40fc-bede-53cf656f690d None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:00.581941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c3b20-52b5-40fc-bede-53cf656f690d None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:00.583260 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 579/1154] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 8 20:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:44:00.588548 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffeca8-bc1d-4e44-8cff-44f7ae17d4fd None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:00.589481 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffeca8-bc1d-4e44-8cff-44f7ae17d4fd None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:00.589740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffeca8-bc1d-4e44-8cff-44f7ae17d4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:00.609974 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-a2ffeca8-bc1d-4e44-8cff-44f7ae17d4fd None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:44:00.611176 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-a2ffeca8-bc1d-4e44-8cff-44f7ae17d4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:00.618869 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 576/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 8 20:44:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:44:00.977938 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c3b20-52b5-40fc-bede-53cf656f690d None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:44:00.980298 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-647c3b20-52b5-40fc-bede-53cf656f690d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:44:00.993356 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c3b20-52b5-40fc-bede-53cf656f690d None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:44:00.997424 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d07d4-a651-4b3a-8468-4092d529851a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2efb666066f4caaa7353656984b5bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:44:00.998078 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d07d4-a651-4b3a-8468-4092d529851a service cinder] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:44:00.998359 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d07d4-a651-4b3a-8468-4092d529851a service cinder] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:44:00.998630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d07d4-a651-4b3a-8468-4092d529851a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:44:01.007379 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d07d4-a651-4b3a-8468-4092d529851a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:44:01.008780 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d07d4-a651-4b3a-8468-4092d529851a service cinder] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:44:01.017955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 580/1156] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:44:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:44:10.604168 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=75 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:44:11.014004 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=14 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:45:15.879700 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b6f66-2bbb-4184-8bb6-9cd542cf2ddf None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:15.880321 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b6f66-2bbb-4184-8bb6-9cd542cf2ddf None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:15.880321 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b6f66-2bbb-4184-8bb6-9cd542cf2ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:15.897008 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39035-87d0-4180-9fb5-829da99538d5 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:15.897609 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39035-87d0-4180-9fb5-829da99538d5 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:15.897609 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39035-87d0-4180-9fb5-829da99538d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:15.901186 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-697b6f66-2bbb-4184-8bb6-9cd542cf2ddf None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:15.902413 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-697b6f66-2bbb-4184-8bb6-9cd542cf2ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:15.910130 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 577/1157] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:45:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:15.917654 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-33b39035-87d0-4180-9fb5-829da99538d5 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:15.918151 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22ccdb-6baf-4625-b4bc-8dadfbd98334 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:15.918441 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22ccdb-6baf-4625-b4bc-8dadfbd98334 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:15.918718 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22ccdb-6baf-4625-b4bc-8dadfbd98334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:15.918877 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-33b39035-87d0-4180-9fb5-829da99538d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:15.926870 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 581/1158] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:45:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:45:15.934804 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57623e-6c9a-4cff-8dd9-fc07eb03c4ef None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:15.935083 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57623e-6c9a-4cff-8dd9-fc07eb03c4ef None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:15.935355 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57623e-6c9a-4cff-8dd9-fc07eb03c4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:15.937761 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-9c22ccdb-6baf-4625-b4bc-8dadfbd98334 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:15.939017 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-9c22ccdb-6baf-4625-b4bc-8dadfbd98334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:15.947541 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 578/1159] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:45:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:15.951875 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22ccdb-6baf-4625-b4bc-8dadfbd98334 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:15.955866 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-2f57623e-6c9a-4cff-8dd9-fc07eb03c4ef None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:15.957046 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-2f57623e-6c9a-4cff-8dd9-fc07eb03c4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:15.960858 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22ccdb-6baf-4625-b4bc-8dadfbd98334 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:15.965391 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 582/1160] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:45:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:45:15.966204 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86041f6d-0c73-4cc6-88a1-37a5f0c2707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:15.966798 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86041f6d-0c73-4cc6-88a1-37a5f0c2707d admin admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:15.967082 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86041f6d-0c73-4cc6-88a1-37a5f0c2707d admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:15.967353 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86041f6d-0c73-4cc6-88a1-37a5f0c2707d admin admin] PATH_INFO: `/v3/domains` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:15.967990 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86041f6d-0c73-4cc6-88a1-37a5f0c2707d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:45:15.968292 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86041f6d-0c73-4cc6-88a1-37a5f0c2707d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:15.969859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57623e-6c9a-4cff-8dd9-fc07eb03c4ef None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:15.970007 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86041f6d-0c73-4cc6-88a1-37a5f0c2707d admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:15.978844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57623e-6c9a-4cff-8dd9-fc07eb03c4ef None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:15.988588 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 579/1161] 10.222.0.36 () {58 vars in 1153 bytes} [Sat Oct 8 20:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:45:15.988814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f35de3-dbb2-4e62-98a0-adde0f842f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:15.988814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f35de3-dbb2-4e62-98a0-adde0f842f48 admin admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:15.988814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f35de3-dbb2-4e62-98a0-adde0f842f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:15.988814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f35de3-dbb2-4e62-98a0-adde0f842f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:15.989131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f35de3-dbb2-4e62-98a0-adde0f842f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 08 20:45:15.989131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f35de3-dbb2-4e62-98a0-adde0f842f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:15.989131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: WARNING py.warnings [None req-66f35de3-dbb2-4e62-98a0-adde0f842f48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:45:15.989131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: warnings.warn(msg) Oct 08 20:45:15.989131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: Oct 08 20:45:15.989131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f35de3-dbb2-4e62-98a0-adde0f842f48 admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:15.989620 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86041f6d-0c73-4cc6-88a1-37a5f0c2707d admin admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:15.999858 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86041f6d-0c73-4cc6-88a1-37a5f0c2707d admin admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:16.006018 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 583/1162] 10.222.0.36 () {58 vars in 1153 bytes} [Sat Oct 8 20:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 08 20:45:16.006174 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfab65-b61f-40cb-b6ce-63140064c525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:16.006174 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfab65-b61f-40cb-b6ce-63140064c525 admin admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:16.006174 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfab65-b61f-40cb-b6ce-63140064c525 admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:16.006174 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfab65-b61f-40cb-b6ce-63140064c525 admin admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:16.006549 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfab65-b61f-40cb-b6ce-63140064c525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:16.007729 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: WARNING py.warnings [None req-50cfab65-b61f-40cb-b6ce-63140064c525 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:45:16.007729 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: warnings.warn(msg) Oct 08 20:45:16.007729 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: Oct 08 20:45:16.008040 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f35de3-dbb2-4e62-98a0-adde0f842f48 admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:16.009018 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfab65-b61f-40cb-b6ce-63140064c525 admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:16.017597 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f35de3-dbb2-4e62-98a0-adde0f842f48 admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:16.022203 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2015d-b6f1-4d96-9984-c3f9b62e5132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:16.022791 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2015d-b6f1-4d96-9984-c3f9b62e5132 admin admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:16.023075 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2015d-b6f1-4d96-9984-c3f9b62e5132 admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:16.023347 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2015d-b6f1-4d96-9984-c3f9b62e5132 admin admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:16.023964 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2015d-b6f1-4d96-9984-c3f9b62e5132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:16.026673 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2015d-b6f1-4d96-9984-c3f9b62e5132 admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:16.047484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 580/1163] 10.222.0.36 () {60 vars in 1153 bytes} [Sat Oct 8 20:45:15 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:45:16.052115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfab65-b61f-40cb-b6ce-63140064c525 admin admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:16.059334 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 584/1164] 10.222.0.36 () {60 vars in 1153 bytes} [Sat Oct 8 20:45:16 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:45:16.063581 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2015d-b6f1-4d96-9984-c3f9b62e5132 admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:16.120432 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfab65-b61f-40cb-b6ce-63140064c525 admin admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:16.125199 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae0ed5-d8a2-41d3-b2c2-ba7d8b43c353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:16.125360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2015d-b6f1-4d96-9984-c3f9b62e5132 admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:16.125803 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0ed5-d8a2-41d3-b2c2-ba7d8b43c353 admin admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:16.126115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0ed5-d8a2-41d3-b2c2-ba7d8b43c353 admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:16.126388 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0ed5-d8a2-41d3-b2c2-ba7d8b43c353 admin admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:16.127013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae0ed5-d8a2-41d3-b2c2-ba7d8b43c353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:16.128938 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae0ed5-d8a2-41d3-b2c2-ba7d8b43c353 admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:16.129859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f0f09-430a-47c7-b286-c69338be162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:16.130478 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f0f09-430a-47c7-b286-c69338be162c admin admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:16.130757 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f0f09-430a-47c7-b286-c69338be162c admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:16.131026 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f0f09-430a-47c7-b286-c69338be162c admin admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:16.131645 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f0f09-430a-47c7-b286-c69338be162c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:16.132635 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: WARNING py.warnings [None req-d17f0f09-430a-47c7-b286-c69338be162c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:45:16.132635 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: warnings.warn(msg) Oct 08 20:45:16.132635 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: Oct 08 20:45:16.133899 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f0f09-430a-47c7-b286-c69338be162c admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:16.152801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 581/1165] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Oct 8 20:45:16 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:45:16.156810 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 585/1166] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Oct 8 20:45:16 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:45:16.156966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae0ed5-d8a2-41d3-b2c2-ba7d8b43c353 admin admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:16.160310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f0f09-430a-47c7-b286-c69338be162c admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:16.166681 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae0ed5-d8a2-41d3-b2c2-ba7d8b43c353 admin admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:16.169813 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f0f09-430a-47c7-b286-c69338be162c admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:16.171188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e20b87-b737-4100-97f3-79953ac44f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:16.171775 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e20b87-b737-4100-97f3-79953ac44f3b admin admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:16.172051 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e20b87-b737-4100-97f3-79953ac44f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:16.172317 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e20b87-b737-4100-97f3-79953ac44f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:16.172944 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e20b87-b737-4100-97f3-79953ac44f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:16.174398 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c7fae-363b-4291-b686-c565cab044bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:16.174539 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e20b87-b737-4100-97f3-79953ac44f3b admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:16.174973 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c7fae-363b-4291-b686-c565cab044bb admin admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:16.175254 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c7fae-363b-4291-b686-c565cab044bb admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:16.175524 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c7fae-363b-4291-b686-c565cab044bb admin admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:16.176150 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c7fae-363b-4291-b686-c565cab044bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:16.177699 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c7fae-363b-4291-b686-c565cab044bb admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:16.185338 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 582/1167] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Oct 8 20:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:45:16.188168 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 586/1168] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Oct 8 20:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:45:16.188939 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e20b87-b737-4100-97f3-79953ac44f3b admin admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:16.191761 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c7fae-363b-4291-b686-c565cab044bb admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:16.199488 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e20b87-b737-4100-97f3-79953ac44f3b admin admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:16.202135 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c7fae-363b-4291-b686-c565cab044bb admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:16.204246 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350223e-4cfd-4ac7-9210-a91015122387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:16.204831 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350223e-4cfd-4ac7-9210-a91015122387 admin admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:16.205109 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350223e-4cfd-4ac7-9210-a91015122387 admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:16.205382 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350223e-4cfd-4ac7-9210-a91015122387 admin admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:16.206052 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350223e-4cfd-4ac7-9210-a91015122387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:16.206892 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d8ec6-32cf-4ea9-8a25-910b9c78051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:16.207529 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d8ec6-32cf-4ea9-8a25-910b9c78051d admin admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:16.207650 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350223e-4cfd-4ac7-9210-a91015122387 admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:16.207813 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d8ec6-32cf-4ea9-8a25-910b9c78051d admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:16.208090 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d8ec6-32cf-4ea9-8a25-910b9c78051d admin admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:16.208814 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d8ec6-32cf-4ea9-8a25-910b9c78051d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:16.210363 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d8ec6-32cf-4ea9-8a25-910b9c78051d admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:16.218496 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 583/1169] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Oct 8 20:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:45:16.222492 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350223e-4cfd-4ac7-9210-a91015122387 admin admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:16.224439 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 587/1170] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Oct 8 20:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:45:16.228451 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d8ec6-32cf-4ea9-8a25-910b9c78051d admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:16.232666 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350223e-4cfd-4ac7-9210-a91015122387 admin admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:16.237243 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b654d-e99e-4795-97a4-5dd8b371fcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:16.237880 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b654d-e99e-4795-97a4-5dd8b371fcce admin admin] REQUEST_METHOD: `PUT` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:16.238186 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b654d-e99e-4795-97a4-5dd8b371fcce admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:16.238310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d8ec6-32cf-4ea9-8a25-910b9c78051d admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:16.238463 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b654d-e99e-4795-97a4-5dd8b371fcce admin admin] PATH_INFO: `/v3/projects/483368cdeae24dde9b99532eb4218661/users/f39f1d6453794ec690258dfe5af74e77/roles/fc58707301804afca34ac8fe194639ed` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:16.242652 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afded036-eba3-4652-b52a-2cc2aab01942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:16.243936 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afded036-eba3-4652-b52a-2cc2aab01942 admin admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:16.244273 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afded036-eba3-4652-b52a-2cc2aab01942 admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:16.244486 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afded036-eba3-4652-b52a-2cc2aab01942 admin admin] PATH_INFO: `/v3/projects/be859a934eca4fed92ab92284bf192c4/users/12828e7b14204991a1072fd4972a949c/roles/fc58707301804afca34ac8fe194639ed` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:16.253865 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b654d-e99e-4795-97a4-5dd8b371fcce admin admin] RBAC: Authorizing `identity:create_grant(project_id=483368cdeae24dde9b99532eb4218661, user_id=f39f1d6453794ec690258dfe5af74e77, role_id=fc58707301804afca34ac8fe194639ed)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:16.254904 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: WARNING py.warnings [None req-8a7b654d-e99e-4795-97a4-5dd8b371fcce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:45:16.254904 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: warnings.warn(msg) Oct 08 20:45:16.254904 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: Oct 08 20:45:16.256843 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b654d-e99e-4795-97a4-5dd8b371fcce admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:16.259156 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afded036-eba3-4652-b52a-2cc2aab01942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be859a934eca4fed92ab92284bf192c4, user_id=12828e7b14204991a1072fd4972a949c, role_id=fc58707301804afca34ac8fe194639ed)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:16.261805 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afded036-eba3-4652-b52a-2cc2aab01942 admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:16.270716 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 584/1171] 10.222.0.36 () {60 vars in 1483 bytes} [Sat Oct 8 20:45:16 2022] PUT /identity/v3/projects/483368cdeae24dde9b99532eb4218661/users/f39f1d6453794ec690258dfe5af74e77/roles/fc58707301804afca34ac8fe194639ed => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:45:16.273971 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 588/1172] 10.222.0.36 () {60 vars in 1483 bytes} [Sat Oct 8 20:45:16 2022] PUT /identity/v3/projects/be859a934eca4fed92ab92284bf192c4/users/12828e7b14204991a1072fd4972a949c/roles/fc58707301804afca34ac8fe194639ed => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:45:16.276258 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5c76e-3877-4b6e-8d9d-64b496480929 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:16.276546 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5c76e-3877-4b6e-8d9d-64b496480929 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:16.276820 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5c76e-3877-4b6e-8d9d-64b496480929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:16.279509 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcf199-0ae3-482e-bf70-9dadd02482b6 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:16.279797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcf199-0ae3-482e-bf70-9dadd02482b6 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:16.280074 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcf199-0ae3-482e-bf70-9dadd02482b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:16.295361 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-2db5c76e-3877-4b6e-8d9d-64b496480929 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:16.296560 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-2db5c76e-3877-4b6e-8d9d-64b496480929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:16.298558 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-65dcf199-0ae3-482e-bf70-9dadd02482b6 None None] MFA Rules not processed for user `38722554f5ac49c2a9cfb6efcc8e8b54`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:16.299714 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-65dcf199-0ae3-482e-bf70-9dadd02482b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:16.336878 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:45:16.347626 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:45:16.356032 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 585/1173] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:45:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:45:16.361004 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 589/1174] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:45:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:45:16.367631 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5c76e-3877-4b6e-8d9d-64b496480929 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:16.370755 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcf199-0ae3-482e-bf70-9dadd02482b6 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:16.372269 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-65dcf199-0ae3-482e-bf70-9dadd02482b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:16.423454 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5c76e-3877-4b6e-8d9d-64b496480929 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:16.427049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9c9b9-496f-4120-a436-582136cc4f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:16.427641 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9c9b9-496f-4120-a436-582136cc4f0a service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:16.427914 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9c9b9-496f-4120-a436-582136cc4f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:16.428178 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9c9b9-496f-4120-a436-582136cc4f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:16.437679 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9c9b9-496f-4120-a436-582136cc4f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:16.439156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9c9b9-496f-4120-a436-582136cc4f0a service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:16.440395 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcf199-0ae3-482e-bf70-9dadd02482b6 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:16.443944 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca882d8a-ebcd-4f83-ba2d-c8cd5a967ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:16.444539 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca882d8a-ebcd-4f83-ba2d-c8cd5a967ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:16.444815 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca882d8a-ebcd-4f83-ba2d-c8cd5a967ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:16.445085 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca882d8a-ebcd-4f83-ba2d-c8cd5a967ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:16.449448 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 586/1175] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:45:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:45:16.454772 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca882d8a-ebcd-4f83-ba2d-c8cd5a967ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:16.456193 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca882d8a-ebcd-4f83-ba2d-c8cd5a967ad0 service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:16.466734 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 590/1176] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:45:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:45:22.375131 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cea18a-8f41-4beb-9053-6d5360c80d9f None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:22.375661 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cea18a-8f41-4beb-9053-6d5360c80d9f None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:22.382944 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cea18a-8f41-4beb-9053-6d5360c80d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:22.427118 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82582c50-bc07-4d61-b96b-7a44239da68d None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:22.428140 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82582c50-bc07-4d61-b96b-7a44239da68d None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:22.428706 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82582c50-bc07-4d61-b96b-7a44239da68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:22.458035 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-91cea18a-8f41-4beb-9053-6d5360c80d9f None None] MFA Rules not processed for user `12828e7b14204991a1072fd4972a949c`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:22.459280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-91cea18a-8f41-4beb-9053-6d5360c80d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:22.482005 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-82582c50-bc07-4d61-b96b-7a44239da68d None None] MFA Rules not processed for user `f39f1d6453794ec690258dfe5af74e77`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:22.484240 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-82582c50-bc07-4d61-b96b-7a44239da68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:22.575224 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 587/1177] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:45:22 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:22.579966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cea18a-8f41-4beb-9053-6d5360c80d9f None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:22.581580 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 591/1178] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:45:22 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:22.587184 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82582c50-bc07-4d61-b96b-7a44239da68d None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:22.598659 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cea18a-8f41-4beb-9053-6d5360c80d9f None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:22.601675 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82582c50-bc07-4d61-b96b-7a44239da68d None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:22.608066 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21660e0d-18a6-447b-bdf1-d0d1c88d0a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:22.608694 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21660e0d-18a6-447b-bdf1-d0d1c88d0a0f admin admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:22.608971 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21660e0d-18a6-447b-bdf1-d0d1c88d0a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:22.609241 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21660e0d-18a6-447b-bdf1-d0d1c88d0a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:22.610626 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21660e0d-18a6-447b-bdf1-d0d1c88d0a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:22.612513 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21660e0d-18a6-447b-bdf1-d0d1c88d0a0f admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:22.613428 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf1e0e-386e-47c7-b628-ea30aaa084d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:22.614213 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf1e0e-386e-47c7-b628-ea30aaa084d1 admin admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:22.614611 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf1e0e-386e-47c7-b628-ea30aaa084d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:22.614982 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf1e0e-386e-47c7-b628-ea30aaa084d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:22.615717 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf1e0e-386e-47c7-b628-ea30aaa084d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:22.617692 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf1e0e-386e-47c7-b628-ea30aaa084d1 admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:22.651872 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 592/1179] 10.222.0.36 () {60 vars in 1153 bytes} [Sat Oct 8 20:45:22 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:45:22.655114 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 588/1180] 10.222.0.36 () {60 vars in 1153 bytes} [Sat Oct 8 20:45:22 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 08 20:45:22.658646 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf1e0e-386e-47c7-b628-ea30aaa084d1 admin admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:22.659322 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21660e0d-18a6-447b-bdf1-d0d1c88d0a0f admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:22.747996 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:45:22.753280 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf1e0e-386e-47c7-b628-ea30aaa084d1 admin admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:22.759717 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81faf27-c799-4a7b-8a19-c3e88f44383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:22.760568 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81faf27-c799-4a7b-8a19-c3e88f44383f admin admin] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:22.760930 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81faf27-c799-4a7b-8a19-c3e88f44383f admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:22.761410 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81faf27-c799-4a7b-8a19-c3e88f44383f admin admin] PATH_INFO: `/v3/users` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:22.762139 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81faf27-c799-4a7b-8a19-c3e88f44383f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:22.764200 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81faf27-c799-4a7b-8a19-c3e88f44383f admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:22.778637 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:45:22.787384 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21660e0d-18a6-447b-bdf1-d0d1c88d0a0f admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:22.796260 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75ca87-ff0e-4f0b-82e3-477e100662bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:22.797151 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75ca87-ff0e-4f0b-82e3-477e100662bc admin admin] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:22.797630 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75ca87-ff0e-4f0b-82e3-477e100662bc admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:22.798011 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75ca87-ff0e-4f0b-82e3-477e100662bc admin admin] PATH_INFO: `/v3/users` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:22.798695 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75ca87-ff0e-4f0b-82e3-477e100662bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:22.801100 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75ca87-ff0e-4f0b-82e3-477e100662bc admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:22.804128 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 589/1181] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Oct 8 20:45:22 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:45:22.808581 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81faf27-c799-4a7b-8a19-c3e88f44383f admin admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:22.822797 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81faf27-c799-4a7b-8a19-c3e88f44383f admin admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:22.829652 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4a2df-2ece-4b6b-8402-782b14ec7f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:22.830707 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4a2df-2ece-4b6b-8402-782b14ec7f47 admin admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:22.831623 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4a2df-2ece-4b6b-8402-782b14ec7f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:22.832188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4a2df-2ece-4b6b-8402-782b14ec7f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:22.834762 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4a2df-2ece-4b6b-8402-782b14ec7f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:22.839658 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 593/1182] 10.222.0.36 () {60 vars in 1144 bytes} [Sat Oct 8 20:45:22 2022] POST /identity/v3/users => generated 295 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 08 20:45:22.842743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75ca87-ff0e-4f0b-82e3-477e100662bc admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:22.843674 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4a2df-2ece-4b6b-8402-782b14ec7f47 admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:22.861642 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75ca87-ff0e-4f0b-82e3-477e100662bc admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:22.874215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 590/1183] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Oct 8 20:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:45:22.878033 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4a2df-2ece-4b6b-8402-782b14ec7f47 admin admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:22.879566 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594d0e5-a0f6-4fd0-9777-599444aea681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:22.880258 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594d0e5-a0f6-4fd0-9777-599444aea681 admin admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:22.880605 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594d0e5-a0f6-4fd0-9777-599444aea681 admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:22.880945 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594d0e5-a0f6-4fd0-9777-599444aea681 admin admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:22.882092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594d0e5-a0f6-4fd0-9777-599444aea681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:22.889974 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594d0e5-a0f6-4fd0-9777-599444aea681 admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:22.898013 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4a2df-2ece-4b6b-8402-782b14ec7f47 admin admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:22.906330 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f779605-ee8b-4f63-a854-7f83405e5081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:22.907540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779605-ee8b-4f63-a854-7f83405e5081 admin admin] REQUEST_METHOD: `PUT` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:22.908046 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779605-ee8b-4f63-a854-7f83405e5081 admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:22.908547 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779605-ee8b-4f63-a854-7f83405e5081 admin admin] PATH_INFO: `/v3/projects/6c93a632b14d45a8ac9816411fad70a4/users/f3cbd8067cc64287baca2a52c5c2f4dd/roles/323ca657fe7b4b878fd8328ef78f29f4` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:22.909809 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 594/1184] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Oct 8 20:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 08 20:45:22.913661 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594d0e5-a0f6-4fd0-9777-599444aea681 admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:22.930924 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594d0e5-a0f6-4fd0-9777-599444aea681 admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:22.943090 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35e55f-8e36-4814-946c-a6a63183087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:22.944496 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e55f-8e36-4814-946c-a6a63183087f admin admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:22.944627 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f779605-ee8b-4f63-a854-7f83405e5081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c93a632b14d45a8ac9816411fad70a4, user_id=f3cbd8067cc64287baca2a52c5c2f4dd, role_id=323ca657fe7b4b878fd8328ef78f29f4)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:22.945045 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e55f-8e36-4814-946c-a6a63183087f admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:22.945479 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e55f-8e36-4814-946c-a6a63183087f admin admin] PATH_INFO: `/v3/projects/95950ae5f52849918c4647fb99e1497c/users/7b277025cf474d0fbf77b041c7a9999c/roles/323ca657fe7b4b878fd8328ef78f29f4` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:22.949024 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f779605-ee8b-4f63-a854-7f83405e5081 admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:22.983106 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 591/1185] 10.222.0.36 () {60 vars in 1483 bytes} [Sat Oct 8 20:45:22 2022] PUT /identity/v3/projects/6c93a632b14d45a8ac9816411fad70a4/users/f3cbd8067cc64287baca2a52c5c2f4dd/roles/323ca657fe7b4b878fd8328ef78f29f4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:45:22.984103 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f779605-ee8b-4f63-a854-7f83405e5081 admin admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:22.986402 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35e55f-8e36-4814-946c-a6a63183087f admin admin] RBAC: Authorizing `identity:create_grant(project_id=95950ae5f52849918c4647fb99e1497c, user_id=7b277025cf474d0fbf77b041c7a9999c, role_id=323ca657fe7b4b878fd8328ef78f29f4)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:22.990266 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35e55f-8e36-4814-946c-a6a63183087f admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:23.013855 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 595/1186] 10.222.0.36 () {60 vars in 1483 bytes} [Sat Oct 8 20:45:22 2022] PUT /identity/v3/projects/95950ae5f52849918c4647fb99e1497c/users/7b277025cf474d0fbf77b041c7a9999c/roles/323ca657fe7b4b878fd8328ef78f29f4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:45:23.018120 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35e55f-8e36-4814-946c-a6a63183087f admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:23.084982 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f779605-ee8b-4f63-a854-7f83405e5081 admin admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:23.106925 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35e55f-8e36-4814-946c-a6a63183087f admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:23.112383 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587af3b-1281-42b2-bba8-9498d022f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:23.113042 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587af3b-1281-42b2-bba8-9498d022f921 admin admin] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:23.113410 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587af3b-1281-42b2-bba8-9498d022f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:23.113751 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587af3b-1281-42b2-bba8-9498d022f921 admin admin] PATH_INFO: `/v3/roles` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:23.114565 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587af3b-1281-42b2-bba8-9498d022f921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:23.116166 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587af3b-1281-42b2-bba8-9498d022f921 admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:23.131688 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 596/1187] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Oct 8 20:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:45:23.135654 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587af3b-1281-42b2-bba8-9498d022f921 admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:23.146193 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587af3b-1281-42b2-bba8-9498d022f921 admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:23.151068 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3fed0-4228-4901-b645-6456f17d23b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:23.151822 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3fed0-4228-4901-b645-6456f17d23b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:23.152173 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3fed0-4228-4901-b645-6456f17d23b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:23.152513 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3fed0-4228-4901-b645-6456f17d23b6 admin admin] PATH_INFO: `/v3/projects/95950ae5f52849918c4647fb99e1497c/users/7b277025cf474d0fbf77b041c7a9999c/roles/323ca657fe7b4b878fd8328ef78f29f4` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:23.154683 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3fed0-4228-4901-b645-6456f17d23b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95950ae5f52849918c4647fb99e1497c, user_id=7b277025cf474d0fbf77b041c7a9999c, role_id=323ca657fe7b4b878fd8328ef78f29f4)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:23.155105 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421703a6-90ed-48bb-912f-1e667303a6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:23.155793 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421703a6-90ed-48bb-912f-1e667303a6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:23.156142 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421703a6-90ed-48bb-912f-1e667303a6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:23.156484 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421703a6-90ed-48bb-912f-1e667303a6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:23.157210 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421703a6-90ed-48bb-912f-1e667303a6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:23.157794 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3fed0-4228-4901-b645-6456f17d23b6 admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:23.158955 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421703a6-90ed-48bb-912f-1e667303a6f9 admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:23.169743 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 597/1188] 10.222.0.36 () {60 vars in 1483 bytes} [Sat Oct 8 20:45:23 2022] PUT /identity/v3/projects/95950ae5f52849918c4647fb99e1497c/users/7b277025cf474d0fbf77b041c7a9999c/roles/323ca657fe7b4b878fd8328ef78f29f4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:45:23.170768 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 592/1189] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Oct 8 20:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 08 20:45:23.177602 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3fed0-4228-4901-b645-6456f17d23b6 admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:23.252390 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3fed0-4228-4901-b645-6456f17d23b6 admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:23.257671 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f701649-35c9-4fd8-99b2-78183051024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:23.259033 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f701649-35c9-4fd8-99b2-78183051024f admin admin] REQUEST_METHOD: `PUT` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:23.259220 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f701649-35c9-4fd8-99b2-78183051024f admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:23.259498 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f701649-35c9-4fd8-99b2-78183051024f admin admin] PATH_INFO: `/v3/projects/6c93a632b14d45a8ac9816411fad70a4/users/f3cbd8067cc64287baca2a52c5c2f4dd/roles/323ca657fe7b4b878fd8328ef78f29f4` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:23.261367 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f701649-35c9-4fd8-99b2-78183051024f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c93a632b14d45a8ac9816411fad70a4, user_id=f3cbd8067cc64287baca2a52c5c2f4dd, role_id=323ca657fe7b4b878fd8328ef78f29f4)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:23.264211 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f701649-35c9-4fd8-99b2-78183051024f admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:23.275819 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 598/1190] 10.222.0.36 () {60 vars in 1483 bytes} [Sat Oct 8 20:45:23 2022] PUT /identity/v3/projects/6c93a632b14d45a8ac9816411fad70a4/users/f3cbd8067cc64287baca2a52c5c2f4dd/roles/323ca657fe7b4b878fd8328ef78f29f4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 08 20:45:28.964678 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4623fe-a7b5-42c1-a5f7-f5186ef4ae3a None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:28.965960 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4623fe-a7b5-42c1-a5f7-f5186ef4ae3a None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:28.966429 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4623fe-a7b5-42c1-a5f7-f5186ef4ae3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:29.006211 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-0c4623fe-a7b5-42c1-a5f7-f5186ef4ae3a None None] MFA Rules not processed for user `f3cbd8067cc64287baca2a52c5c2f4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:29.009651 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-0c4623fe-a7b5-42c1-a5f7-f5186ef4ae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:29.074374 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:45:29.120372 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 593/1191] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:45:28 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:29.134863 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f701649-35c9-4fd8-99b2-78183051024f admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:29.136868 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-6f701649-35c9-4fd8-99b2-78183051024f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:29.186750 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:45:29.267035 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f701649-35c9-4fd8-99b2-78183051024f admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:29.275535 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b69c-17b1-4c2a-bf77-ec15418b2b40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7210700b41444499b0a6cfe978445247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:29.277657 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b69c-17b1-4c2a-bf77-ec15418b2b40 service glance] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:29.278141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b69c-17b1-4c2a-bf77-ec15418b2b40 service glance] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:29.278521 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b69c-17b1-4c2a-bf77-ec15418b2b40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:29.291903 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9622a-660b-466d-bef9-50764e85e295 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:29.292410 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9622a-660b-466d-bef9-50764e85e295 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:29.292832 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9622a-660b-466d-bef9-50764e85e295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:29.331115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-84c9622a-660b-466d-bef9-50764e85e295 None None] MFA Rules not processed for user `7b277025cf474d0fbf77b041c7a9999c`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:29.332704 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-84c9622a-660b-466d-bef9-50764e85e295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:29.367265 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422b69c-17b1-4c2a-bf77-ec15418b2b40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:29.369543 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422b69c-17b1-4c2a-bf77-ec15418b2b40 service glance] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:29.385609 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 599/1192] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:45:29 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:45:29.441878 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 594/1193] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:45:29 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:45:29.463844 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b69c-17b1-4c2a-bf77-ec15418b2b40 service glance] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:29.465575 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-e422b69c-17b1-4c2a-bf77-ec15418b2b40 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:29.513041 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b69c-17b1-4c2a-bf77-ec15418b2b40 service glance] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:29.566741 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860eb1c-4176-4904-9437-09bfd04a0a8e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7210700b41444499b0a6cfe978445247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:29.567716 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860eb1c-4176-4904-9437-09bfd04a0a8e service glance] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:29.568118 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860eb1c-4176-4904-9437-09bfd04a0a8e service glance] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:29.568482 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860eb1c-4176-4904-9437-09bfd04a0a8e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:29.700850 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860eb1c-4176-4904-9437-09bfd04a0a8e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:29.702373 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860eb1c-4176-4904-9437-09bfd04a0a8e service glance] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:29.713234 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 600/1194] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:45:29 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:45:38.038660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de178a3-1564-4c3e-b921-e1d7f20a2207 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:38.039324 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de178a3-1564-4c3e-b921-e1d7f20a2207 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:38.039324 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de178a3-1564-4c3e-b921-e1d7f20a2207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:38.072323 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-3de178a3-1564-4c3e-b921-e1d7f20a2207 None None] MFA Rules not processed for user `12828e7b14204991a1072fd4972a949c`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:38.074264 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-3de178a3-1564-4c3e-b921-e1d7f20a2207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:38.082670 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 595/1195] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:45:38 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:38.409244 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57497a-df9c-45f0-9393-c50d22fbd42f None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:38.409818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57497a-df9c-45f0-9393-c50d22fbd42f None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:38.409818 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57497a-df9c-45f0-9393-c50d22fbd42f None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:38.411419 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 601/1196] 10.222.0.36 () {54 vars in 961 bytes} [Sat Oct 8 20:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:45:38.422179 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac203dd-284a-4be5-afc0-14c7193a4145 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:38.422531 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac203dd-284a-4be5-afc0-14c7193a4145 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:38.422963 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac203dd-284a-4be5-afc0-14c7193a4145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:38.489804 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-cac203dd-284a-4be5-afc0-14c7193a4145 None None] MFA Rules not processed for user `017db52cc36f4bdb9448afe74edab753`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:38.491062 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-cac203dd-284a-4be5-afc0-14c7193a4145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:38.622167 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9834f-4dad-443f-b6e1-8edc1bd3fd30 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:38.622447 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9834f-4dad-443f-b6e1-8edc1bd3fd30 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:38.622721 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9834f-4dad-443f-b6e1-8edc1bd3fd30 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:38.624480 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 602/1197] 10.222.0.36 () {54 vars in 912 bytes} [Sat Oct 8 20:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:45:38.639368 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 596/1198] 10.222.0.36 () {58 vars in 1058 bytes} [Sat Oct 8 20:45:38 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:38.639691 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d31725-cdff-40bc-9998-0139d549e880 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:38.640346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d31725-cdff-40bc-9998-0139d549e880 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:38.641337 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d31725-cdff-40bc-9998-0139d549e880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:38.672094 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-e0d31725-cdff-40bc-9998-0139d549e880 None None] MFA Rules not processed for user `017db52cc36f4bdb9448afe74edab753`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:38.674393 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-e0d31725-cdff-40bc-9998-0139d549e880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:38.691013 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 603/1199] 10.222.0.36 () {58 vars in 1009 bytes} [Sat Oct 8 20:45:38 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:45:38.704188 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac203dd-284a-4be5-afc0-14c7193a4145 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:38.717043 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac203dd-284a-4be5-afc0-14c7193a4145 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:38.729784 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71761f3-1c53-4824-8868-4599c7ac01e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7210700b41444499b0a6cfe978445247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:38.730682 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71761f3-1c53-4824-8868-4599c7ac01e5 service glance] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:38.731408 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71761f3-1c53-4824-8868-4599c7ac01e5 service glance] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:38.731844 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71761f3-1c53-4824-8868-4599c7ac01e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:38.746556 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71761f3-1c53-4824-8868-4599c7ac01e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:38.748613 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71761f3-1c53-4824-8868-4599c7ac01e5 service glance] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:38.760215 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 597/1200] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:45:38 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:45:39.118863 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec9676-5ecc-456d-a4e5-72172130e9ae None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:39.119129 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec9676-5ecc-456d-a4e5-72172130e9ae None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:39.119402 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec9676-5ecc-456d-a4e5-72172130e9ae None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:39.120734 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 604/1201] 10.222.0.36 () {54 vars in 912 bytes} [Sat Oct 8 20:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:45:39.125841 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cab92f-c583-4a8d-9d07-a0f2990a3833 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:39.126329 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cab92f-c583-4a8d-9d07-a0f2990a3833 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:39.126427 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cab92f-c583-4a8d-9d07-a0f2990a3833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:39.146042 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-18cab92f-c583-4a8d-9d07-a0f2990a3833 None None] MFA Rules not processed for user `98b1f2e36ec948eabeb7c0c1bdf87216`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:39.147283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-18cab92f-c583-4a8d-9d07-a0f2990a3833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:39.181974 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=100 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:45:39.218277 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 598/1202] 10.222.0.36 () {58 vars in 1009 bytes} [Sat Oct 8 20:45:39 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:39.237640 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec9676-5ecc-456d-a4e5-72172130e9ae None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:39.251746 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec9676-5ecc-456d-a4e5-72172130e9ae None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:39.255960 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c3439-6510-4af2-8367-d92f4f638557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:39.256653 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c3439-6510-4af2-8367-d92f4f638557 service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:39.257225 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c3439-6510-4af2-8367-d92f4f638557 service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:39.257562 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c3439-6510-4af2-8367-d92f4f638557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:39.265345 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c3439-6510-4af2-8367-d92f4f638557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:39.267212 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c3439-6510-4af2-8367-d92f4f638557 service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:39.280212 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 605/1203] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:45:39 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:45:39.697432 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c223ef-ce2f-468f-bacd-08026f110fbf None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:39.697725 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c223ef-ce2f-468f-bacd-08026f110fbf None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:39.698038 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c223ef-ce2f-468f-bacd-08026f110fbf None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:39.699509 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 599/1204] 10.222.0.36 () {54 vars in 961 bytes} [Sat Oct 8 20:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:45:39.704799 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dad27a-9377-469f-8ef8-1806a73b6239 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:39.705250 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dad27a-9377-469f-8ef8-1806a73b6239 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:39.705346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dad27a-9377-469f-8ef8-1806a73b6239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:39.720731 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c223ef-ce2f-468f-bacd-08026f110fbf None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:39.727275 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-f8dad27a-9377-469f-8ef8-1806a73b6239 None None] MFA Rules not processed for user `017db52cc36f4bdb9448afe74edab753`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:39.728542 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-f8dad27a-9377-469f-8ef8-1806a73b6239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:39.738767 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 606/1205] 10.222.0.36 () {58 vars in 1058 bytes} [Sat Oct 8 20:45:39 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:39.745803 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fe564-d338-4e99-9a59-ededb60c5bae None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:39.746310 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fe564-d338-4e99-9a59-ededb60c5bae None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:39.746626 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fe564-d338-4e99-9a59-ededb60c5bae None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:39.747946 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 607/1206] 10.222.0.36 () {54 vars in 912 bytes} [Sat Oct 8 20:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 08 20:45:39.753962 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16101c-c660-4c7a-80fc-25ad0733f3a6 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:39.754253 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16101c-c660-4c7a-80fc-25ad0733f3a6 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:39.754958 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16101c-c660-4c7a-80fc-25ad0733f3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:39.778788 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-3d16101c-c660-4c7a-80fc-25ad0733f3a6 None None] MFA Rules not processed for user `017db52cc36f4bdb9448afe74edab753`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:39.780082 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-3d16101c-c660-4c7a-80fc-25ad0733f3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:39.790285 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 608/1207] 10.222.0.36 () {58 vars in 1009 bytes} [Sat Oct 8 20:45:39 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:39.804347 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16101c-c660-4c7a-80fc-25ad0733f3a6 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:39.816227 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16101c-c660-4c7a-80fc-25ad0733f3a6 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:39.816751 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c223ef-ce2f-468f-bacd-08026f110fbf None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:39.819950 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f91cb-9dd3-4413-909c-95ce039c2290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:39.820578 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f91cb-9dd3-4413-909c-95ce039c2290 service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:39.820859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f91cb-9dd3-4413-909c-95ce039c2290 service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:39.821148 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f91cb-9dd3-4413-909c-95ce039c2290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:39.822906 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7913f-e37b-407b-8089-454b7bbab885 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc15a49c674447d9d85b17eb70c3db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:39.823465 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7913f-e37b-407b-8089-454b7bbab885 service placement] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:39.823738 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7913f-e37b-407b-8089-454b7bbab885 service placement] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:39.824049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7913f-e37b-407b-8089-454b7bbab885 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:39.825764 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-ffc7913f-e37b-407b-8089-454b7bbab885 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:39.832856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f91cb-9dd3-4413-909c-95ce039c2290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:39.834885 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f91cb-9dd3-4413-909c-95ce039c2290 service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:39.844369 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7913f-e37b-407b-8089-454b7bbab885 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:39.846024 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7913f-e37b-407b-8089-454b7bbab885 service placement] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:39.847915 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 609/1208] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:45:39 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:45:39.860761 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 600/1209] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:45:39 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:45:49.729032 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3c36f-7edf-4a6c-a52d-74ea5be2da65 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:49.729589 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3c36f-7edf-4a6c-a52d-74ea5be2da65 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:49.729589 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3c36f-7edf-4a6c-a52d-74ea5be2da65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:49.751614 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-abb3c36f-7edf-4a6c-a52d-74ea5be2da65 None None] MFA Rules not processed for user `98b1f2e36ec948eabeb7c0c1bdf87216`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:49.753140 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-abb3c36f-7edf-4a6c-a52d-74ea5be2da65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:49.759727 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 610/1210] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Oct 8 20:45:49 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:49.773905 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7913f-e37b-407b-8089-454b7bbab885 service placement] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:49.783540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7913f-e37b-407b-8089-454b7bbab885 service placement] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:49.787062 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af944d6d-9335-40e7-8a34-889b4fe9c487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:49.787652 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af944d6d-9335-40e7-8a34-889b4fe9c487 service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:49.787935 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af944d6d-9335-40e7-8a34-889b4fe9c487 service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:49.788202 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af944d6d-9335-40e7-8a34-889b4fe9c487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:49.796995 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af944d6d-9335-40e7-8a34-889b4fe9c487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:49.798455 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af944d6d-9335-40e7-8a34-889b4fe9c487 service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:49.810017 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 601/1211] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:45:49 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:45:50.694458 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d37d6-6d75-49f7-8365-7bd402638a6d None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:50.694782 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d37d6-6d75-49f7-8365-7bd402638a6d None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:50.695021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d37d6-6d75-49f7-8365-7bd402638a6d None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:50.697160 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 611/1212] 10.222.0.36 () {54 vars in 921 bytes} [Sat Oct 8 20:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:45:50.742978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7f9a6-86f0-40ad-80fc-6b88059d796b None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:50.744042 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7f9a6-86f0-40ad-80fc-6b88059d796b None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:50.744491 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7f9a6-86f0-40ad-80fc-6b88059d796b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:50.767716 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-68e7f9a6-86f0-40ad-80fc-6b88059d796b None None] MFA Rules not processed for user `017db52cc36f4bdb9448afe74edab753`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:50.769271 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-68e7f9a6-86f0-40ad-80fc-6b88059d796b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:50.780104 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 602/1213] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Oct 8 20:45:50 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:45:50.801987 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d37d6-6d75-49f7-8365-7bd402638a6d None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:50.816767 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d37d6-6d75-49f7-8365-7bd402638a6d None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:50.822574 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a778a-7ddb-4a91-9a18-c171b595e3a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:50.823289 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a778a-7ddb-4a91-9a18-c171b595e3a2 service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:50.823628 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a778a-7ddb-4a91-9a18-c171b595e3a2 service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:50.823955 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a778a-7ddb-4a91-9a18-c171b595e3a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:50.833836 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a778a-7ddb-4a91-9a18-c171b595e3a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:50.835563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a778a-7ddb-4a91-9a18-c171b595e3a2 service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:50.847420 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 612/1214] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:45:50 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:45:57.398511 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5aa5aa-8f7e-4ce8-a58b-0004fa71261b None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:57.399124 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5aa5aa-8f7e-4ce8-a58b-0004fa71261b None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:57.399124 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5aa5aa-8f7e-4ce8-a58b-0004fa71261b None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:57.401187 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 603/1215] 10.222.0.36 () {54 vars in 921 bytes} [Sat Oct 8 20:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:45:57.412346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61213db4-641e-44c8-ba7c-1c4307a53754 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:57.412936 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61213db4-641e-44c8-ba7c-1c4307a53754 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:57.412936 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61213db4-641e-44c8-ba7c-1c4307a53754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:57.429430 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=100 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:45:57.458056 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-61213db4-641e-44c8-ba7c-1c4307a53754 None None] MFA Rules not processed for user `017db52cc36f4bdb9448afe74edab753`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:45:57.459616 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-61213db4-641e-44c8-ba7c-1c4307a53754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:45:57.474960 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 613/1216] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Oct 8 20:45:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:45:57.511811 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5aa5aa-8f7e-4ce8-a58b-0004fa71261b None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:45:57.531600 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5aa5aa-8f7e-4ce8-a58b-0004fa71261b None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:45:57.538069 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd575ba7-4f0a-4de0-98ad-e53068c30b98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:45:57.539054 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575ba7-4f0a-4de0-98ad-e53068c30b98 service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:45:57.539554 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575ba7-4f0a-4de0-98ad-e53068c30b98 service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:45:57.539823 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575ba7-4f0a-4de0-98ad-e53068c30b98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:45:57.552966 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd575ba7-4f0a-4de0-98ad-e53068c30b98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:45:57.555558 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd575ba7-4f0a-4de0-98ad-e53068c30b98 service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:45:57.565240 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 604/1217] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:45:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:46:07.447707 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=2 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:46:07.560846 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=56 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:46:10.295750 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61213db4-641e-44c8-ba7c-1c4307a53754 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:46:10.304983 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61213db4-641e-44c8-ba7c-1c4307a53754 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:46:10.308633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a712f7-63e8-4c2e-b410-e9b5cad12ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:46:10.309295 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a712f7-63e8-4c2e-b410-e9b5cad12ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:46:10.309583 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a712f7-63e8-4c2e-b410-e9b5cad12ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:46:10.309856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a712f7-63e8-4c2e-b410-e9b5cad12ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:46:10.319538 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a712f7-63e8-4c2e-b410-e9b5cad12ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:46:10.321071 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a712f7-63e8-4c2e-b410-e9b5cad12ab1 service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:46:10.341916 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 614/1218] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:46:10 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:46:12.341564 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0178d-0d74-479b-ac3d-ee87171d76af None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:46:12.342534 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0178d-0d74-479b-ac3d-ee87171d76af None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:46:12.342979 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0178d-0d74-479b-ac3d-ee87171d76af None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:46:12.344675 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 605/1219] 10.222.0.36 () {54 vars in 921 bytes} [Sat Oct 8 20:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:46:12.350145 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca3d0a-8a20-4d67-bace-a63e24cc1f3c None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:46:12.350662 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca3d0a-8a20-4d67-bace-a63e24cc1f3c None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:46:12.350868 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca3d0a-8a20-4d67-bace-a63e24cc1f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:46:12.376971 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-28ca3d0a-8a20-4d67-bace-a63e24cc1f3c None None] MFA Rules not processed for user `017db52cc36f4bdb9448afe74edab753`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:46:12.378403 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-28ca3d0a-8a20-4d67-bace-a63e24cc1f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:46:12.393706 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 615/1220] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Oct 8 20:46:12 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:46:12.402551 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0178d-0d74-479b-ac3d-ee87171d76af None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:46:12.420403 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0178d-0d74-479b-ac3d-ee87171d76af None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:46:12.428282 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554cb4a-dcaf-4e32-b531-23ca1ce934c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:46:12.428890 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554cb4a-dcaf-4e32-b531-23ca1ce934c4 service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:46:12.429170 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554cb4a-dcaf-4e32-b531-23ca1ce934c4 service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:46:12.429438 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554cb4a-dcaf-4e32-b531-23ca1ce934c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:46:12.441691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554cb4a-dcaf-4e32-b531-23ca1ce934c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:46:12.443759 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554cb4a-dcaf-4e32-b531-23ca1ce934c4 service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:46:12.457984 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 606/1221] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:46:12 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:46:22.370396 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=9 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:46:22.451874 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=6 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:46:27.604751 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e814b-8ce7-42d3-a364-3a6a62990911 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:46:27.605314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e814b-8ce7-42d3-a364-3a6a62990911 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:46:27.605314 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e814b-8ce7-42d3-a364-3a6a62990911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:46:27.624448 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-412e814b-8ce7-42d3-a364-3a6a62990911 None None] MFA Rules not processed for user `f39f1d6453794ec690258dfe5af74e77`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:46:27.625615 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-412e814b-8ce7-42d3-a364-3a6a62990911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:46:27.632176 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 616/1222] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:46:27 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:46:27.968061 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a16d6-1f84-4255-b28f-cc71c2043631 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:46:27.968559 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a16d6-1f84-4255-b28f-cc71c2043631 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:46:27.968658 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a16d6-1f84-4255-b28f-cc71c2043631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:46:27.990146 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-a70a16d6-1f84-4255-b28f-cc71c2043631 None None] MFA Rules not processed for user `98b1f2e36ec948eabeb7c0c1bdf87216`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:46:27.991358 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-a70a16d6-1f84-4255-b28f-cc71c2043631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:46:27.999120 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 607/1223] 10.222.0.36 () {58 vars in 1009 bytes} [Sat Oct 8 20:46:27 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:46:28.010355 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e814b-8ce7-42d3-a364-3a6a62990911 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:46:28.019876 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e814b-8ce7-42d3-a364-3a6a62990911 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:46:28.023359 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec25d7-e209-49cd-aeac-828aac591b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:46:28.024444 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec25d7-e209-49cd-aeac-828aac591b73 service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:46:28.024726 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec25d7-e209-49cd-aeac-828aac591b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:46:28.024999 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec25d7-e209-49cd-aeac-828aac591b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:46:28.031800 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec25d7-e209-49cd-aeac-828aac591b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:46:28.033217 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec25d7-e209-49cd-aeac-828aac591b73 service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:46:28.041332 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 617/1224] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:46:28 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:46:37.984028 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=3 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:46:38.037596 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=9 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:46:52.725465 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088f21f-6b79-4273-a2fa-df46891f1a91 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:46:52.725973 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088f21f-6b79-4273-a2fa-df46891f1a91 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:46:52.726075 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088f21f-6b79-4273-a2fa-df46891f1a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:46:52.745420 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-3088f21f-6b79-4273-a2fa-df46891f1a91 None None] MFA Rules not processed for user `f39f1d6453794ec690258dfe5af74e77`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:46:52.746729 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-3088f21f-6b79-4273-a2fa-df46891f1a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:46:52.753374 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 608/1225] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:46:52 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:47:02.740254 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=3 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:47:08.449717 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b66ff-147f-4ec0-a9ba-0a87114006ba None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:47:08.450248 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b66ff-147f-4ec0-a9ba-0a87114006ba None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:47:08.450346 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b66ff-147f-4ec0-a9ba-0a87114006ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:47:08.468611 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-7b3b66ff-147f-4ec0-a9ba-0a87114006ba None None] MFA Rules not processed for user `f39f1d6453794ec690258dfe5af74e77`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:47:08.469778 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-7b3b66ff-147f-4ec0-a9ba-0a87114006ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:47:08.476458 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 618/1226] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:47:08 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:47:18.463636 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=3 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:48:07.955607 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a869da-fe00-4869-991d-3636fe0a4ba1 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:48:07.956094 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a869da-fe00-4869-991d-3636fe0a4ba1 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:48:07.956184 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a869da-fe00-4869-991d-3636fe0a4ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:48:07.975598 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-c7a869da-fe00-4869-991d-3636fe0a4ba1 None None] MFA Rules not processed for user `f39f1d6453794ec690258dfe5af74e77`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:48:07.977097 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-c7a869da-fe00-4869-991d-3636fe0a4ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:48:07.985389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 609/1227] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:48:07 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:48:17.970259 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=3 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:48:20.780016 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b66ff-147f-4ec0-a9ba-0a87114006ba None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:48:20.798389 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b66ff-147f-4ec0-a9ba-0a87114006ba None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:48:20.801966 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186be27f-6833-4816-962a-e9612afd977e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:48:20.802563 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186be27f-6833-4816-962a-e9612afd977e service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:48:20.802841 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186be27f-6833-4816-962a-e9612afd977e service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:48:20.803115 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186be27f-6833-4816-962a-e9612afd977e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:48:20.812277 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186be27f-6833-4816-962a-e9612afd977e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:48:20.813679 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186be27f-6833-4816-962a-e9612afd977e service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:48:20.823360 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 619/1228] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:48:20 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:48:30.818874 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=10 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:49:40.508990 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a869da-fe00-4869-991d-3636fe0a4ba1 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:49:40.534691 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a869da-fe00-4869-991d-3636fe0a4ba1 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:49:40.539746 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c5f65-75b0-4795-a712-a10b63514f17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc15a49c674447d9d85b17eb70c3db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:49:40.540348 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c5f65-75b0-4795-a712-a10b63514f17 service placement] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:49:40.540628 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c5f65-75b0-4795-a712-a10b63514f17 service placement] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:49:40.540900 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c5f65-75b0-4795-a712-a10b63514f17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:49:40.549165 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c5f65-75b0-4795-a712-a10b63514f17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:49:40.550791 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c5f65-75b0-4795-a712-a10b63514f17 service placement] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:49:40.560187 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 610/1229] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:49:40 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:49:50.556268 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=10 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:50:06.096949 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dbe82-be10-4ba4-8038-cc75b3dca2c2 None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:50:06.097471 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dbe82-be10-4ba4-8038-cc75b3dca2c2 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:50:06.097598 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dbe82-be10-4ba4-8038-cc75b3dca2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:50:06.116904 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-849dbe82-be10-4ba4-8038-cc75b3dca2c2 None None] MFA Rules not processed for user `12828e7b14204991a1072fd4972a949c`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:50:06.118135 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-849dbe82-be10-4ba4-8038-cc75b3dca2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:50:06.124875 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 620/1230] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:50:06 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:50:16.111859 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=3 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:50:29.429092 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c5f65-75b0-4795-a712-a10b63514f17 service placement] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:50:29.438156 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c5f65-75b0-4795-a712-a10b63514f17 service placement] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:50:29.441829 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe41462-a965-43dd-abe6-727f1822b36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:50:29.442463 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe41462-a965-43dd-abe6-727f1822b36c service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:50:29.442740 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe41462-a965-43dd-abe6-727f1822b36c service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:50:29.443008 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe41462-a965-43dd-abe6-727f1822b36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:50:29.450975 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe41462-a965-43dd-abe6-727f1822b36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:50:29.452379 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe41462-a965-43dd-abe6-727f1822b36c service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:50:29.461535 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 611/1231] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:50:29 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:50:29.651919 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dbe82-be10-4ba4-8038-cc75b3dca2c2 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:50:29.714641 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dbe82-be10-4ba4-8038-cc75b3dca2c2 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:50:29.718141 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb644fd3-7516-4330-90c5-46332dc01828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2efb666066f4caaa7353656984b5bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:50:29.718742 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644fd3-7516-4330-90c5-46332dc01828 service cinder] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:50:29.719024 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644fd3-7516-4330-90c5-46332dc01828 service cinder] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:50:29.719294 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644fd3-7516-4330-90c5-46332dc01828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:50:29.728247 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb644fd3-7516-4330-90c5-46332dc01828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:50:29.729938 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb644fd3-7516-4330-90c5-46332dc01828 service cinder] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:50:29.738888 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 621/1232] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:50:29 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:50:32.454760 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef532427-75de-415c-ad6e-a4de3d523b31 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:50:32.455617 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef532427-75de-415c-ad6e-a4de3d523b31 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:50:32.455895 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef532427-75de-415c-ad6e-a4de3d523b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:50:32.476675 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-ef532427-75de-415c-ad6e-a4de3d523b31 None None] MFA Rules not processed for user `f39f1d6453794ec690258dfe5af74e77`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:50:32.478232 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-ef532427-75de-415c-ad6e-a4de3d523b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:50:32.486111 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 612/1233] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:50:32 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:50:39.421972 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb644fd3-7516-4330-90c5-46332dc01828 service cinder] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:50:39.431101 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb644fd3-7516-4330-90c5-46332dc01828 service cinder] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:50:39.434675 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfbb76-0a42-4267-9507-9084708d5d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:50:39.435259 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfbb76-0a42-4267-9507-9084708d5d56 service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:50:39.435533 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfbb76-0a42-4267-9507-9084708d5d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:50:39.435797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfbb76-0a42-4267-9507-9084708d5d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:50:39.444770 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfbb76-0a42-4267-9507-9084708d5d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:50:39.446197 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfbb76-0a42-4267-9507-9084708d5d56 service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:50:39.465083 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 622/1234] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:50:39 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:50:40.644873 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef532427-75de-415c-ad6e-a4de3d523b31 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:50:40.654135 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef532427-75de-415c-ad6e-a4de3d523b31 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:50:40.657676 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec855ed-f8ee-4ff8-8998-584a930f4ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:50:40.658308 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec855ed-f8ee-4ff8-8998-584a930f4ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:50:40.658605 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec855ed-f8ee-4ff8-8998-584a930f4ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:50:40.658849 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec855ed-f8ee-4ff8-8998-584a930f4ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:50:40.668801 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec855ed-f8ee-4ff8-8998-584a930f4ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:50:40.670281 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec855ed-f8ee-4ff8-8998-584a930f4ab8 service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:50:40.681482 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 613/1235] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:50:40 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:50:49.462669 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=40 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:50:50.676672 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=15 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:00.022240 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfbb76-0a42-4267-9507-9084708d5d56 service neutron] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:00.030686 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfbb76-0a42-4267-9507-9084708d5d56 service neutron] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:00.034327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6add9-d405-44fd-9cee-4f4b5755f51f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:00.034988 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6add9-d405-44fd-9cee-4f4b5755f51f service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:00.035328 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6add9-d405-44fd-9cee-4f4b5755f51f service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:00.036309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6add9-d405-44fd-9cee-4f4b5755f51f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:00.043781 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6add9-d405-44fd-9cee-4f4b5755f51f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:00.045257 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6add9-d405-44fd-9cee-4f4b5755f51f service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:00.053995 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 623/1236] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:00 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:10.049650 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=6 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:51:51.451479 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec855ed-f8ee-4ff8-8998-584a930f4ab8 service neutron] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:51.462904 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec855ed-f8ee-4ff8-8998-584a930f4ab8 service neutron] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:51.472591 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb4bee-fba9-49f4-8fe5-77e478c7db4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:51.473536 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb4bee-fba9-49f4-8fe5-77e478c7db4f service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:51.474204 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb4bee-fba9-49f4-8fe5-77e478c7db4f service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:51.476127 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb4bee-fba9-49f4-8fe5-77e478c7db4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:51.486088 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb4bee-fba9-49f4-8fe5-77e478c7db4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:51.488757 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb4bee-fba9-49f4-8fe5-77e478c7db4f service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:51.517390 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 614/1237] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:51 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:51:59.559423 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6add9-d405-44fd-9cee-4f4b5755f51f service neutron] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:51:59.567737 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6add9-d405-44fd-9cee-4f4b5755f51f service neutron] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:51:59.571671 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd619fb-3f01-4a30-831d-8f588d18d5ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:51:59.572253 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd619fb-3f01-4a30-831d-8f588d18d5ce service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:51:59.572530 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd619fb-3f01-4a30-831d-8f588d18d5ce service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:51:59.572826 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd619fb-3f01-4a30-831d-8f588d18d5ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:51:59.633069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd619fb-3f01-4a30-831d-8f588d18d5ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:51:59.634555 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd619fb-3f01-4a30-831d-8f588d18d5ce service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:51:59.652856 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 624/1238] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:51:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:01.495935 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=6 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:02.856319 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53132a10-375f-4f7d-bba3-5b52373bcba9 None None] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.857294 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53132a10-375f-4f7d-bba3-5b52373bcba9 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.857581 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53132a10-375f-4f7d-bba3-5b52373bcba9 None None] PATH_INFO: `/` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.864273 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 615/1239] 10.222.0.36 () {54 vars in 921 bytes} [Sat Oct 8 20:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:02.868910 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359f7ff-fe79-4576-865a-fa9bbb13068f None None] REQUEST_METHOD: `POST` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.869357 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359f7ff-fe79-4576-865a-fa9bbb13068f None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.869458 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359f7ff-fe79-4576-865a-fa9bbb13068f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.938549 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.auth.core [None req-7359f7ff-fe79-4576-865a-fa9bbb13068f None None] MFA Rules not processed for user `9fc15a49c674447d9d85b17eb70c3db3`. Rule list: `[]` (Enabled: `True`). {{(pid=94742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:02.939637 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-7359f7ff-fe79-4576-865a-fa9bbb13068f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:02.948464 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 625/1240] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Oct 8 20:52:02 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 08 20:52:02.959201 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53132a10-375f-4f7d-bba3-5b52373bcba9 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:02.973446 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53132a10-375f-4f7d-bba3-5b52373bcba9 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:02.978818 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc63d0-edb0-4445-978f-1909a6e7075d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc15a49c674447d9d85b17eb70c3db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:02.979462 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc63d0-edb0-4445-978f-1909a6e7075d service placement] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:02.979745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc63d0-edb0-4445-978f-1909a6e7075d service placement] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:02.980044 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc63d0-edb0-4445-978f-1909a6e7075d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:02.988808 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc63d0-edb0-4445-978f-1909a6e7075d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:02.990389 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc63d0-edb0-4445-978f-1909a6e7075d service placement] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:03.000438 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 616/1241] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:02 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:06.201262 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622529dd-31db-477b-bc17-9dfb4d90a309 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:06.201806 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622529dd-31db-477b-bc17-9dfb4d90a309 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:06.202065 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622529dd-31db-477b-bc17-9dfb4d90a309 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:06.203655 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 626/1242] 10.222.0.36 () {54 vars in 921 bytes} [Sat Oct 8 20:52:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:52:06.214809 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2409-4930-457c-9988-570c5556c0c6 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:06.215283 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2409-4930-457c-9988-570c5556c0c6 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:06.215375 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2409-4930-457c-9988-570c5556c0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:06.235949 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-ceaf2409-4930-457c-9988-570c5556c0c6 None None] MFA Rules not processed for user `9fc15a49c674447d9d85b17eb70c3db3`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:06.237526 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-ceaf2409-4930-457c-9988-570c5556c0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:06.250091 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 617/1243] 10.222.0.36 () {58 vars in 1018 bytes} [Sat Oct 8 20:52:06 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:06.263395 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622529dd-31db-477b-bc17-9dfb4d90a309 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:06.281013 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622529dd-31db-477b-bc17-9dfb4d90a309 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:06.286402 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11a05e-03b2-46e7-b081-21266fdb0944 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc15a49c674447d9d85b17eb70c3db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:06.286849 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11a05e-03b2-46e7-b081-21266fdb0944 service placement] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:06.287132 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11a05e-03b2-46e7-b081-21266fdb0944 service placement] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:06.287408 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11a05e-03b2-46e7-b081-21266fdb0944 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:06.293442 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf2409-4930-457c-9988-570c5556c0c6 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:06.298396 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11a05e-03b2-46e7-b081-21266fdb0944 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:06.299984 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11a05e-03b2-46e7-b081-21266fdb0944 service placement] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:06.305410 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf2409-4930-457c-9988-570c5556c0c6 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:06.310685 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c72a3b-2cb0-43bf-8324-bb3fbbc71328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:06.311325 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c72a3b-2cb0-43bf-8324-bb3fbbc71328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:06.311601 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c72a3b-2cb0-43bf-8324-bb3fbbc71328 admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:06.311872 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c72a3b-2cb0-43bf-8324-bb3fbbc71328 admin admin] PATH_INFO: `/v3/users/12828e7b14204991a1072fd4972a949c` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:06.313015 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c72a3b-2cb0-43bf-8324-bb3fbbc71328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12828e7b14204991a1072fd4972a949c)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:06.314160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: WARNING py.warnings [None req-10c72a3b-2cb0-43bf-8324-bb3fbbc71328 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:52:06.314160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: warnings.warn(msg) Oct 08 20:52:06.314160 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: Oct 08 20:52:06.315686 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c72a3b-2cb0-43bf-8324-bb3fbbc71328 admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:06.315801 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 627/1244] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:06 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:52:06.382973 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-10c72a3b-2cb0-43bf-8324-bb3fbbc71328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12828e7b14204991a1072fd4972a949c'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.393181 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-10c72a3b-2cb0-43bf-8324-bb3fbbc71328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12828e7b14204991a1072fd4972a949c'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.393865 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-10c72a3b-2cb0-43bf-8324-bb3fbbc71328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12828e7b14204991a1072fd4972a949c'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.400902 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-10c72a3b-2cb0-43bf-8324-bb3fbbc71328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12828e7b14204991a1072fd4972a949c'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.401525 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-10c72a3b-2cb0-43bf-8324-bb3fbbc71328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12828e7b14204991a1072fd4972a949c'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.424732 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 618/1245] 10.222.0.36 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:06 2022] DELETE /identity/v3/users/12828e7b14204991a1072fd4972a949c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:06.596781 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11a05e-03b2-46e7-b081-21266fdb0944 service placement] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:06.614936 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11a05e-03b2-46e7-b081-21266fdb0944 service placement] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:06.671375 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:06.672004 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:06.672288 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:06.672560 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] PATH_INFO: `/v3/projects/be859a934eca4fed92ab92284bf192c4` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:06.673662 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be859a934eca4fed92ab92284bf192c4)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:06.674718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: WARNING py.warnings [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 08 20:52:06.674718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: warnings.warn(msg) Oct 08 20:52:06.674718 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: Oct 08 20:52:06.675942 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:06.718250 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:06.734017 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be859a934eca4fed92ab92284bf192c4', 'request_id': 'req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.739781 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be859a934eca4fed92ab92284bf192c4', 'request_id': 'req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.752619 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be859a934eca4fed92ab92284bf192c4', 'request_id': 'req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.764906 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] The token cache is being invalidate because project be859a934eca4fed92ab92284bf192c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:06.765194 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.765810 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.767473 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 628/1246] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:06 2022] DELETE /identity/v3/projects/be859a934eca4fed92ab92284bf192c4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:06.771540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c72a3b-2cb0-43bf-8324-bb3fbbc71328 admin admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:06.773641 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-10c72a3b-2cb0-43bf-8324-bb3fbbc71328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:06.786355 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c72a3b-2cb0-43bf-8324-bb3fbbc71328 admin admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:06.841637 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ddbde-0179-4e8b-a844-700acb314525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:06.842410 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ddbde-0179-4e8b-a844-700acb314525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:06.842695 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ddbde-0179-4e8b-a844-700acb314525 admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:06.842974 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ddbde-0179-4e8b-a844-700acb314525 admin admin] PATH_INFO: `/v3/users/f3cbd8067cc64287baca2a52c5c2f4dd` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:06.844089 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ddbde-0179-4e8b-a844-700acb314525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3cbd8067cc64287baca2a52c5c2f4dd)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:06.846049 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ddbde-0179-4e8b-a844-700acb314525 admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:06.893028 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-a64ddbde-0179-4e8b-a844-700acb314525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3cbd8067cc64287baca2a52c5c2f4dd'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.898148 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:06.900247 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-a64ddbde-0179-4e8b-a844-700acb314525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3cbd8067cc64287baca2a52c5c2f4dd'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.901171 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-a64ddbde-0179-4e8b-a844-700acb314525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3cbd8067cc64287baca2a52c5c2f4dd'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.909058 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-a64ddbde-0179-4e8b-a844-700acb314525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3cbd8067cc64287baca2a52c5c2f4dd'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.909693 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-a64ddbde-0179-4e8b-a844-700acb314525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3cbd8067cc64287baca2a52c5c2f4dd'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:06.926540 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 619/1247] 10.222.0.36 () {58 vars in 1224 bytes} [Sat Oct 8 20:52:06 2022] DELETE /identity/v3/users/f3cbd8067cc64287baca2a52c5c2f4dd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:07.094025 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:07.095426 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:07.110591 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8b9c5-2936-48ed-bde7-232a6b879eb1 admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:07.167319 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b0033-b8c7-4d2b-8231-fad081a67a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:07.167939 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b0033-b8c7-4d2b-8231-fad081a67a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:07.168215 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b0033-b8c7-4d2b-8231-fad081a67a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:07.168484 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b0033-b8c7-4d2b-8231-fad081a67a9f admin admin] PATH_INFO: `/v3/projects/6c93a632b14d45a8ac9816411fad70a4` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:07.169593 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b0033-b8c7-4d2b-8231-fad081a67a9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c93a632b14d45a8ac9816411fad70a4)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:07.171499 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b0033-b8c7-4d2b-8231-fad081a67a9f admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:07.217480 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-b93b0033-b8c7-4d2b-8231-fad081a67a9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c93a632b14d45a8ac9816411fad70a4', 'request_id': 'req-b93b0033-b8c7-4d2b-8231-fad081a67a9f'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:07.223001 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-b93b0033-b8c7-4d2b-8231-fad081a67a9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c93a632b14d45a8ac9816411fad70a4', 'request_id': 'req-b93b0033-b8c7-4d2b-8231-fad081a67a9f'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:07.229654 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-b93b0033-b8c7-4d2b-8231-fad081a67a9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c93a632b14d45a8ac9816411fad70a4', 'request_id': 'req-b93b0033-b8c7-4d2b-8231-fad081a67a9f'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:07.240651 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-b93b0033-b8c7-4d2b-8231-fad081a67a9f admin admin] The token cache is being invalidate because project 6c93a632b14d45a8ac9816411fad70a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:52:07.240941 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-b93b0033-b8c7-4d2b-8231-fad081a67a9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:07.241552 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-b93b0033-b8c7-4d2b-8231-fad081a67a9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:52:07.243542 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 629/1248] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 8 20:52:07 2022] DELETE /identity/v3/projects/6c93a632b14d45a8ac9816411fad70a4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:52:16.923197 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=9,keystone:INSERT=1,keystone:DELETE=3 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:17.237733 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:DELETE=12,keystone:SELECT=62,keystone:INSERT=2 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:26.944285 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add3a4a-ddab-4b44-9389-a76685c987e2 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:26.944779 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add3a4a-ddab-4b44-9389-a76685c987e2 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:26.944779 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add3a4a-ddab-4b44-9389-a76685c987e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:26.964533 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-5add3a4a-ddab-4b44-9389-a76685c987e2 None None] MFA Rules not processed for user `f39f1d6453794ec690258dfe5af74e77`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:52:26.965734 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-5add3a4a-ddab-4b44-9389-a76685c987e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:27.018176 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 620/1249] 10.222.0.36 () {58 vars in 958 bytes} [Sat Oct 8 20:52:26 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:52:27.336016 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b0033-b8c7-4d2b-8231-fad081a67a9f admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:27.337445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-b93b0033-b8c7-4d2b-8231-fad081a67a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:27.393518 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b0033-b8c7-4d2b-8231-fad081a67a9f admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:27.397092 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047a707-c3f6-4394-9dd5-1bc5d349e0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:27.397713 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047a707-c3f6-4394-9dd5-1bc5d349e0da service neutron] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:27.398025 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047a707-c3f6-4394-9dd5-1bc5d349e0da service neutron] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:27.398297 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047a707-c3f6-4394-9dd5-1bc5d349e0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:27.399971 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-8047a707-c3f6-4394-9dd5-1bc5d349e0da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:27.409072 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047a707-c3f6-4394-9dd5-1bc5d349e0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:27.410511 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047a707-c3f6-4394-9dd5-1bc5d349e0da service neutron] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:27.418726 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 630/1250] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:27 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:28.097079 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add3a4a-ddab-4b44-9389-a76685c987e2 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:28.098656 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-5add3a4a-ddab-4b44-9389-a76685c987e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:28.173755 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add3a4a-ddab-4b44-9389-a76685c987e2 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:28.178838 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343eca0-7029-4007-87b7-fdfcdad57b9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc15a49c674447d9d85b17eb70c3db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:28.179475 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343eca0-7029-4007-87b7-fdfcdad57b9f service placement] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:28.179753 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343eca0-7029-4007-87b7-fdfcdad57b9f service placement] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:28.180024 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343eca0-7029-4007-87b7-fdfcdad57b9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:28.181699 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-f343eca0-7029-4007-87b7-fdfcdad57b9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:28.192660 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343eca0-7029-4007-87b7-fdfcdad57b9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:28.194266 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343eca0-7029-4007-87b7-fdfcdad57b9f service placement] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:28.204222 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 621/1251] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:28 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:35.473725 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047a707-c3f6-4394-9dd5-1bc5d349e0da service neutron] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:35.475239 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-8047a707-c3f6-4394-9dd5-1bc5d349e0da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:35.545837 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047a707-c3f6-4394-9dd5-1bc5d349e0da service neutron] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:35.551021 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66418ec7-30be-436d-bd25-fa1b27d5b0b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:35.551633 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66418ec7-30be-436d-bd25-fa1b27d5b0b4 service nova] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:35.551913 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66418ec7-30be-436d-bd25-fa1b27d5b0b4 service nova] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:35.552188 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66418ec7-30be-436d-bd25-fa1b27d5b0b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:35.553907 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-66418ec7-30be-436d-bd25-fa1b27d5b0b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:35.565189 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66418ec7-30be-436d-bd25-fa1b27d5b0b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:35.566739 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66418ec7-30be-436d-bd25-fa1b27d5b0b4 service nova] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:35.576445 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 631/1252] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:35 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:52:38.200370 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=57 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:40.410277 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343eca0-7029-4007-87b7-fdfcdad57b9f service placement] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:52:40.411771 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-f343eca0-7029-4007-87b7-fdfcdad57b9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:40.425806 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343eca0-7029-4007-87b7-fdfcdad57b9f service placement] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:52:40.430745 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe89ce-cc08-428d-9efc-0a21607bc7d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '017db52cc36f4bdb9448afe74edab753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:52:40.431341 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe89ce-cc08-428d-9efc-0a21607bc7d2 service nova] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:52:40.431619 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe89ce-cc08-428d-9efc-0a21607bc7d2 service nova] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:52:40.431887 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe89ce-cc08-428d-9efc-0a21607bc7d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:52:40.433558 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-15fe89ce-cc08-428d-9efc-0a21607bc7d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:52:40.445082 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe89ce-cc08-428d-9efc-0a21607bc7d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:52:40.446679 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe89ce-cc08-428d-9efc-0a21607bc7d2 service nova] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:52:40.456272 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 622/1253] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:52:40 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 08 20:52:45.572283 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=58 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:52:50.452425 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=6 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:44.412607 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37036fee-f9bf-4aa3-9e1c-11a2853e5f61 None None] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:44.413088 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37036fee-f9bf-4aa3-9e1c-11a2853e5f61 None None] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:44.413185 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37036fee-f9bf-4aa3-9e1c-11a2853e5f61 None None] PATH_INFO: `/` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:44.414615 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 632/1254] 10.222.0.36 () {54 vars in 961 bytes} [Sat Oct 8 20:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 08 20:54:44.419578 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91140f3-b425-46a4-a9d2-d4ab63e1a933 None None] REQUEST_METHOD: `POST` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:44.420016 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91140f3-b425-46a4-a9d2-d4ab63e1a933 None None] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:44.420132 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91140f3-b425-46a4-a9d2-d4ab63e1a933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:44.458643 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.auth.core [None req-e91140f3-b425-46a4-a9d2-d4ab63e1a933 None None] MFA Rules not processed for user `9fc15a49c674447d9d85b17eb70c3db3`. Rule list: `[]` (Enabled: `True`). {{(pid=94741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 08 20:54:44.459835 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-e91140f3-b425-46a4-a9d2-d4ab63e1a933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:44.507053 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 623/1255] 10.222.0.36 () {58 vars in 1058 bytes} [Sat Oct 8 20:54:44 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 08 20:54:44.514529 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37036fee-f9bf-4aa3-9e1c-11a2853e5f61 None None] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:54:44.527447 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37036fee-f9bf-4aa3-9e1c-11a2853e5f61 None None] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:54:44.532681 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c670eae-0123-401d-92a3-5174a46ee06a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc15a49c674447d9d85b17eb70c3db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:54:44.533259 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c670eae-0123-401d-92a3-5174a46ee06a service placement] REQUEST_METHOD: `GET` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:54:44.533537 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c670eae-0123-401d-92a3-5174a46ee06a service placement] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:54:44.533805 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c670eae-0123-401d-92a3-5174a46ee06a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:54:44.535512 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-3c670eae-0123-401d-92a3-5174a46ee06a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:54:44.546797 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c670eae-0123-401d-92a3-5174a46ee06a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:54:44.549069 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c670eae-0123-401d-92a3-5174a46ee06a service placement] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:54:44.558525 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 633/1256] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:54:44 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:54:54.505200 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=29 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:54:54.554551 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=6 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:13.108915 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91140f3-b425-46a4-a9d2-d4ab63e1a933 None None] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:13.118498 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91140f3-b425-46a4-a9d2-d4ab63e1a933 None None] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:13.121982 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2f7fd-7d9d-49b3-bb79-3bdf852d917d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b1f2e36ec948eabeb7c0c1bdf87216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac7915cef1d4e3288a30fd015fcce50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:13.122573 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2f7fd-7d9d-49b3-bb79-3bdf852d917d service neutron] REQUEST_METHOD: `GET` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:13.122849 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2f7fd-7d9d-49b3-bb79-3bdf852d917d service neutron] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:13.123115 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2f7fd-7d9d-49b3-bb79-3bdf852d917d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:13.124785 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-a2d2f7fd-7d9d-49b3-bb79-3bdf852d917d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:13.209431 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2f7fd-7d9d-49b3-bb79-3bdf852d917d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:13.210978 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2f7fd-7d9d-49b3-bb79-3bdf852d917d service neutron] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:13.220183 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 624/1257] 10.222.0.36 () {60 vars in 1365 bytes} [Sat Oct 8 20:55:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 08 20:55:19.336825 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c670eae-0123-401d-92a3-5174a46ee06a service placement] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:19.338325 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-3c670eae-0123-401d-92a3-5174a46ee06a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:19.352251 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c670eae-0123-401d-92a3-5174a46ee06a service placement] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:19.356779 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe297de2-dc67-4afb-80d4-ee048b7f54d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:19.357488 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe297de2-dc67-4afb-80d4-ee048b7f54d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:19.357770 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe297de2-dc67-4afb-80d4-ee048b7f54d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:19.358077 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe297de2-dc67-4afb-80d4-ee048b7f54d4 admin admin] PATH_INFO: `/v3/users/f39f1d6453794ec690258dfe5af74e77` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:19.374365 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe297de2-dc67-4afb-80d4-ee048b7f54d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f39f1d6453794ec690258dfe5af74e77)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:19.376309 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe297de2-dc67-4afb-80d4-ee048b7f54d4 admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:19.421131 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-fe297de2-dc67-4afb-80d4-ee048b7f54d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f39f1d6453794ec690258dfe5af74e77'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:19.428389 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-fe297de2-dc67-4afb-80d4-ee048b7f54d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f39f1d6453794ec690258dfe5af74e77'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:19.429046 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-fe297de2-dc67-4afb-80d4-ee048b7f54d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f39f1d6453794ec690258dfe5af74e77'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:19.429653 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-fe297de2-dc67-4afb-80d4-ee048b7f54d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f39f1d6453794ec690258dfe5af74e77'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:19.441994 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-fe297de2-dc67-4afb-80d4-ee048b7f54d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f39f1d6453794ec690258dfe5af74e77'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:19.454167 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 634/1258] 10.222.0.36 () {58 vars in 1224 bytes} [Sat Oct 8 20:55:19 2022] DELETE /identity/v3/users/f39f1d6453794ec690258dfe5af74e77 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:19.632117 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2f7fd-7d9d-49b3-bb79-3bdf852d917d service neutron] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:19.642108 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2f7fd-7d9d-49b3-bb79-3bdf852d917d service neutron] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:19.697552 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b26e93-42e9-4aa6-b94a-f52eeb45b356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:19.698217 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b26e93-42e9-4aa6-b94a-f52eeb45b356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:19.698494 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b26e93-42e9-4aa6-b94a-f52eeb45b356 admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:19.698763 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b26e93-42e9-4aa6-b94a-f52eeb45b356 admin admin] PATH_INFO: `/v3/projects/483368cdeae24dde9b99532eb4218661` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:19.710124 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b26e93-42e9-4aa6-b94a-f52eeb45b356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=483368cdeae24dde9b99532eb4218661)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:19.712173 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b26e93-42e9-4aa6-b94a-f52eeb45b356 admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:19.757509 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-82b26e93-42e9-4aa6-b94a-f52eeb45b356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '483368cdeae24dde9b99532eb4218661', 'request_id': 'req-82b26e93-42e9-4aa6-b94a-f52eeb45b356'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:19.762782 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-82b26e93-42e9-4aa6-b94a-f52eeb45b356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '483368cdeae24dde9b99532eb4218661', 'request_id': 'req-82b26e93-42e9-4aa6-b94a-f52eeb45b356'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:19.770048 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-82b26e93-42e9-4aa6-b94a-f52eeb45b356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '483368cdeae24dde9b99532eb4218661', 'request_id': 'req-82b26e93-42e9-4aa6-b94a-f52eeb45b356'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:19.771921 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:19.783046 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-82b26e93-42e9-4aa6-b94a-f52eeb45b356 admin admin] The token cache is being invalidate because project 483368cdeae24dde9b99532eb4218661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:55:19.783854 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-82b26e93-42e9-4aa6-b94a-f52eeb45b356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:19.784641 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-82b26e93-42e9-4aa6-b94a-f52eeb45b356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:19.786159 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 625/1259] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:19 2022] DELETE /identity/v3/projects/483368cdeae24dde9b99532eb4218661 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:19.790079 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe297de2-dc67-4afb-80d4-ee048b7f54d4 admin admin] Authenticating user token {{(pid=94742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:19.791457 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.fernet_utils [None req-fe297de2-dc67-4afb-80d4-ee048b7f54d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:19.805267 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe297de2-dc67-4afb-80d4-ee048b7f54d4 admin admin] Validating token access rules against request {{(pid=94742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:19.862494 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173dad1-0ca8-487e-b719-d1ef34a4654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:19.863031 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173dad1-0ca8-487e-b719-d1ef34a4654a admin admin] REQUEST_METHOD: `DELETE` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:19.863327 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173dad1-0ca8-487e-b719-d1ef34a4654a admin admin] SCRIPT_NAME: `/identity` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:19.863595 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173dad1-0ca8-487e-b719-d1ef34a4654a admin admin] PATH_INFO: `/v3/users/7b277025cf474d0fbf77b041c7a9999c` {{(pid=94742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:19.864684 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173dad1-0ca8-487e-b719-d1ef34a4654a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b277025cf474d0fbf77b041c7a9999c)` {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:19.866627 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173dad1-0ca8-487e-b719-d1ef34a4654a admin admin] RBAC: Authorization granted {{(pid=94742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:19.912190 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-5173dad1-0ca8-487e-b719-d1ef34a4654a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b277025cf474d0fbf77b041c7a9999c'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:19.918908 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-5173dad1-0ca8-487e-b719-d1ef34a4654a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b277025cf474d0fbf77b041c7a9999c'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:19.919571 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-5173dad1-0ca8-487e-b719-d1ef34a4654a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b277025cf474d0fbf77b041c7a9999c'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:19.920181 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-5173dad1-0ca8-487e-b719-d1ef34a4654a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b277025cf474d0fbf77b041c7a9999c'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:19.926125 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:19.934000 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG keystone.notifications [None req-5173dad1-0ca8-487e-b719-d1ef34a4654a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b277025cf474d0fbf77b041c7a9999c'} {{(pid=94742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:19.946571 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: [pid: 94742|app: 0|req: 635/1260] 10.222.0.36 () {58 vars in 1224 bytes} [Sat Oct 8 20:55:19 2022] DELETE /identity/v3/users/7b277025cf474d0fbf77b041c7a9999c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:20.115325 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b26e93-42e9-4aa6-b94a-f52eeb45b356 admin admin] Authenticating user token {{(pid=94741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 08 20:55:20.116713 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.fernet_utils [None req-82b26e93-42e9-4aa6-b94a-f52eeb45b356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 08 20:55:20.129238 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b26e93-42e9-4aa6-b94a-f52eeb45b356 admin admin] Validating token access rules against request {{(pid=94741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 08 20:55:20.184942 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91109da5-bd5d-4ea9-8c00-84bf706bdcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38722554f5ac49c2a9cfb6efcc8e8b54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b2e45ebde4268bba84c6dbc8036cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 08 20:55:20.185572 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91109da5-bd5d-4ea9-8c00-84bf706bdcdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 08 20:55:20.185850 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91109da5-bd5d-4ea9-8c00-84bf706bdcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 08 20:55:20.186221 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91109da5-bd5d-4ea9-8c00-84bf706bdcdb admin admin] PATH_INFO: `/v3/projects/95950ae5f52849918c4647fb99e1497c` {{(pid=94741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 08 20:55:20.187309 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91109da5-bd5d-4ea9-8c00-84bf706bdcdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=95950ae5f52849918c4647fb99e1497c)` {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 08 20:55:20.189216 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91109da5-bd5d-4ea9-8c00-84bf706bdcdb admin admin] RBAC: Authorization granted {{(pid=94741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 08 20:55:20.237401 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-91109da5-bd5d-4ea9-8c00-84bf706bdcdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95950ae5f52849918c4647fb99e1497c', 'request_id': 'req-91109da5-bd5d-4ea9-8c00-84bf706bdcdb'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:20.244238 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-91109da5-bd5d-4ea9-8c00-84bf706bdcdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95950ae5f52849918c4647fb99e1497c', 'request_id': 'req-91109da5-bd5d-4ea9-8c00-84bf706bdcdb'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:20.251452 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-91109da5-bd5d-4ea9-8c00-84bf706bdcdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95950ae5f52849918c4647fb99e1497c', 'request_id': 'req-91109da5-bd5d-4ea9-8c00-84bf706bdcdb'} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:20.267554 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-91109da5-bd5d-4ea9-8c00-84bf706bdcdb admin admin] The token cache is being invalidate because project 95950ae5f52849918c4647fb99e1497c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 08 20:55:20.268395 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-91109da5-bd5d-4ea9-8c00-84bf706bdcdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:20.270061 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG keystone.notifications [None req-91109da5-bd5d-4ea9-8c00-84bf706bdcdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 08 20:55:20.271990 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: [pid: 94741|app: 0|req: 626/1261] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 8 20:55:20 2022] DELETE /identity/v3/projects/95950ae5f52849918c4647fb99e1497c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 08 20:55:29.943154 dv-osbrick-master-4-ceph devstack@keystone.service[94742]: DEBUG dbcounter [-] [94742] Writing DB stats keystone:SELECT=6,keystone:DELETE=2,keystone:INSERT=1 {{(pid=94742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 08 20:55:30.263839 dv-osbrick-master-4-ceph devstack@keystone.service[94741]: DEBUG dbcounter [-] [94741] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}